00000001:02000400:3.0F:1789479735.649419:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789479755.425707:0:3522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789479757.383026:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 671 MB/s 00000001:01000000:1.0F:1789479757.632502:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 795 MB/s 00000001:01000000:2.0:1789479757.882332:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4291 MB/s 00000020:02000000:1.0:1789479758.515427:0:3613:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g9b6d8f0 00000400:02000000:0.0:1789479759.639278:0:3629:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.144@tcp [8/256/0/180] 00008000:02000000:2.0:1789479763.210172:0:3778:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789479823.850655:0:5747:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789479837.831542:0:6497:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789479837.831547:0:6497:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789479837.831549:0:6497:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789479837.831885:0:6497:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001dcc58f2 00000080:02000400:3.0:1789479837.831894:0:6497:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789479837.843594:0:6497:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789479837.843607:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789479837.843648:0:6497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000022405779) 00000020:00000080:3.0:1789479837.843665:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789479837.925573:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789479837.925663:0:6497:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1789479837.951004:0:6497:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789479837.951375:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789479837.951382:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789479837.951413:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cd2c 00000020:01000004:3.0:1789479837.951420:0:6497:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789479837.951424:0:6497:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789479837.951441:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001dcc58f2 from MGS 00000020:01000004:3.0:1789479837.951445:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789479837.951455:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a6fe2a9a) 00000020:00000080:3.0:1789479837.951466:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789479837.951523:0:6497:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001dcc58f2 from MGS, refs=2 00080000:01000000:3.0:1789479837.951528:0:6497:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789479837.951534:0:6497:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cd3a 00000100:00100000:3.0:1789479837.951620:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789479837.951737:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789479837.951742:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789479837.955154:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789479837.955185:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789479837.956895:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789479837.957053:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789479837.957058:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789479837.966179:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789479837.966216:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789479837.966689:0:6497:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789479837.966698:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789479837.967846:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479837.967851:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479837.967853:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479837.968090:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479837.968093:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479837.968095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479837.968734:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789479837.970991:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789479838.218375:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4719 MB/s 00000001:01000000:3.0:1789479838.470255:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4734 MB/s 00000001:01000000:1.0:1789479838.720546:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 555 MB/s 00000001:01000000:3.0:1789479838.971087:0:6497:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1027 MB/s 00080000:10000000:3.0:1789479838.975435:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1789479838.980279:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789479838.982911:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789479838.983912:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789479838.983963:0:6497:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789479838.983997:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789479838.984154:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789479838.984179:0:6497:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789479838.984600:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479838.984783:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789479838.984791:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789479838.985438:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789479838.985447:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789479838.985728:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789479838.985735:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1789479838.986514:0:6516:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789479838.986566:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789479838.986590:0:6497:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.144@tcp' 00000020:01000004:3.0:1789479838.986593:0:6497:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789479838.986641:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.144@tcp (typ=mgc) 00000020:00000080:3.0:1789479838.986652:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.144@tcp (00000000ce33952c) 00000020:00000080:3.0:1789479838.986666:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789479838.986737:0:6497:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000960993aa@MGC192.168.206.144@tcp: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789479838.987303:0:6497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.144@tcp-0 is initialized 00000040:01000000:3.0:1789479838.987310:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789479838.987650:0:6517:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789479838.987680:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.144@tcp (uuid 6a679393-20ef-489d-b204-2797ec519e97) 00000020:00000080:3.0:1789479838.987694:0:6497:0:(genops.c:1384:class_connect()) connect: client 6a679393-20ef-489d-b204-2797ec519e97, cookie 0xdaa289fda243cd48 00000100:00080000:3.0:1789479838.987703:0:6497:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789479838.987711:0:6497:0:(import.c:666:import_select_connection()) MGC192.168.206.144@tcp: import 00000000960993aa using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789479838.987750:0:6497:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000003cea902 x1876405527773312/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789479838.987771:0:6497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6a679393-20ef-489d-b204-2797ec519e97->MGS 00000020:01000004:3.0:1789479838.987787:0:6497:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789479838.987792:0:6497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789479838.987803:0:6497:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000483d962) 00000020:00000080:3.0:1789479838.987814:0:6497:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789479838.987995:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003cea902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527773312:0@lo:250: 00000100:00100000:1.0:1789479838.988079:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479838.988466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773312 00000100:00100000:3.0:1789479838.988479:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773312 00000100:00100000:3.0:1789479838.988508:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789479838.988513:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000568948ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876405527773312:12345-0@lo:250: 00010000:00080000:3.0:1789479838.988533:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6a679393-20ef-489d-b204-2797ec519e97@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1789479838.988551:0:6512:0:(genops.c:1384:class_connect()) connect: client 6a679393-20ef-489d-b204-2797ec519e97, cookie 0xdaa289fda243cd56 00000100:00080000:3.0:1789479838.988658:0:6512:0:(import.c:65:import_set_state_nolock()) 00000000617c8c92 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479838.988716:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000568948ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+5:3644:x1876405527773312:12345-0@lo:250: Request processed in 201us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479838.988724:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479838.992889:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789479838.992904:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.144@tcp: connect to target with instance 0 00000100:00080000:1.0:1789479838.992911:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789479838.992916:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789479838.992920:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000960993aa MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789479838.992924:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789479838.992934:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789479838.992942:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003cea902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527773312:0@lo:250: 00000100:00100000:3.0:1789479839.002347:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479839.002544:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789479839.002550:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789479839.010217:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479839.010232:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789479839.011445:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789479839.011453:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789479839.021041:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479839.022769:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789479839.022781:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789479839.025977:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789479839.025991:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789479839.105050:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479839.105256:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789479839.105263:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789479839.107863:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789479839.107874:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789479839.109909:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479839.110069:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789479839.110076:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789479839.111992:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789479839.112002:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789479839.112900:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479839.113079:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789479839.113085:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789479839.119595:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789479839.123651:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789479839.124576:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479839.124739:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789479839.124744:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789479839.129720:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789479839.129734:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789479839.155068:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479839.155455:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789479839.155466:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789479839.157730:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789479839.157743:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789479839.162932:0:6497:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789479839.162947:0:6497:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789479839.163834:0:6497:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789479839.163860:0:6497:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789479839.163865:0:6497:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789479839.163954:0:6497:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789479839.163984:0:6497:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789479839.163989:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789479839.163990:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789479839.163992:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479839.163993:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479839.163994:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479839.163995:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479839.163996:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789479839.163997:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789479839.163998:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479839.163999:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479839.164001:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479839.164002:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479839.164004:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789479839.164006:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789479839.164007:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789479839.164008:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479839.164009:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479839.164010:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479839.164011:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479839.164012:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789479839.164013:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789479839.164014:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479839.164015:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479839.164016:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479839.164017:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479839.164055:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789479839.164070:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ccc7232 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773440:0@lo:253: 00000100:00100000:2.0:1789479839.164144:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479839.164384:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1e3a89b going to sleep for 11 seconds 00000100:00100000:1.0:1789479839.164597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773440 00000100:00100000:1.0:1789479839.164605:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773440 00000100:00100000:1.0:1789479839.164695:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479839.164702:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf88d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+5:6497:x1876405527773440:12345-0@lo:253: 20000000:01000000:1.0:1789479839.164753:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789479839.164756:0:6515:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789479839.165045:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789479839.165098:0:6515:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789479839.165503:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479839.166431:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789479839.166605:0:6515:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789479839.166608:0:6515:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789479839.166613:0:6515:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789479839.166616:0:6515:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789479839.166628:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789479839.166738:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479839.166892:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789479839.166917:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479839.166936:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789479839.166952:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789479839.166967:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789479839.167018:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789479839.167025:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789479839.167038:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789479839.167044:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789479839.167056:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789479839.167060:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789479839.167071:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789479839.167085:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789479839.167110:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789479839.167115:0:6515:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789479839.167123:0:6515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479839.167243:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789479839.167253:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789479839.167268:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789479839.167663:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789479839.167683:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789479839.167692:0:6515:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789479839.167718:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789479839.167727:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789479839.167750:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789479839.167767:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789479839.167782:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789479839.167790:0:6515:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789479839.167813:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789479839.167820:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789479839.167832:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789479839.167847:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789479839.167904:0:6515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789479839.167928:0:6515:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789479839.167946:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789479839.168414:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789479839.168578:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789479839.168597:0:6515:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:2.0:1789479839.168599:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789479839.168611:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789479839.168617:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789479839.168628:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789479839.168633:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1789479839.168644:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789479839.168651:0:6515:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789479839.168663:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789479839.168676:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789479839.168699:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789479839.168702:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789479839.168706:0:6515:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789479839.168756:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789479839.168758:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789479839.169005:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789479839.169143:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789479839.169163:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789479839.169177:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789479839.169185:0:6515:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789479839.169483:0:6515:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789479839.169824:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789479839.169965:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789479839.169984:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789479839.169998:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1789479839.170007:0:6515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789479839.170010:0:6515:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789479839.170013:0:6515:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789479839.170016:0:6515:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789479839.170019:0:6515:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789479839.170024:0:6515:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789479839.170757:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1789479839.170877:0:6515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789479839.181494:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789479839.181530:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789479839.181546:0:6515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789479839.181566:0:6515:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789479839.181585:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181599:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181607:0:6515:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181613:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181618:0:6515:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181624:0:6515:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181859:0:6515:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a898f1a7 already unused, calling callback (000000007e7d2c58) 00010000:00010000:2.0:1789479839.181863:0:6515:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181870:0:6515:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181880:0:6515:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181887:0:6515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.181892:0:6515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cd5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789479839.181908:0:6515:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789479839.189840:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf88d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+5:6497:x1876405527773440:12345-0@lo:253: Request processed in 25132us (25691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.189857:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479839.189964:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ccc7232 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773440:0@lo:253: 10000000:01000000:0.0:1789479839.189979:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789479839.189982:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479839.189984:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479839.189985:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479839.189987:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789479839.189988:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479839.189989:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479839.189991:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479839.189992:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479839.189993:0:6497:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789479839.189994:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479839.189996:0:6497:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789479839.190015:0:6497:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001dcc58f2 from lustre-MDT0000 10000000:01000000:0.0:1789479839.190044:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789479839.190047:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789479839.190050:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a6a95c999c0 10000000:01000000:0.0:1789479839.190054:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789479839.190061:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a6a95c999c0 from 1 10000000:01000000:0.0:1789479839.190076:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789479839.190121:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.190131:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.190140:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479839.190158:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f54723a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773568:0@lo:101: 00000100:00100000:0.0:1789479839.190225:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479839.190282:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb8c2f4b going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.193739:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773568 00000100:00100000:2.0:1789479839.193753:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773568 00000100:00100000:2.0:1789479839.193866:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479839.193875:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000507d7db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+5:6497:x1876405527773568:12345-0@lo:101: 00010000:00010000:2.0:1789479839.193891:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479839.193909:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cd64 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.193934:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.193951:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.193960:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da9f9523, rc 0) 00000100:00100000:2.0:1789479839.194052:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000507d7db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+6:6497:x1876405527773568:12345-0@lo:101: Request processed in 178us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.194059:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479839.194137:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f54723a4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773568:0@lo:101: 00010000:00010000:1.0:1789479839.194159:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.194167:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.194296:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773696:0@lo:501: 00000100:00100000:1.0:1789479839.194329:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.194664:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2364b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.194756:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773696 00000100:00100000:0.0:1789479839.194762:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773696 00000100:00100000:0.0:1789479839.194794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789479839.194801:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fff22d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+6:6497:x1876405527773696:12345-0@lo:501: 00000100:00100000:0.0:1789479839.194880:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fff22d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+6:6497:x1876405527773696:12345-0@lo:501: Request processed in 79us (550us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479839.194887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789479839.194961:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773696:0@lo:501: 10000000:01000000:1.0:1789479839.194989:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789479839.195007:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195015:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.195023:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6a83cfb000 10000000:01000000:1.0:1789479839.195028:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789479839.195031:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a6a83cfb000 10000000:01000000:1.0:1789479839.195033:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789479839.195036:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a6a83cfb000 from 1 10000000:01000000:1.0:1789479839.195038:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789479839.195060:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195066:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195072:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.195083:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773824:0@lo:101: 00000100:00100000:1.0:1789479839.195117:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.195128:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2364b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.195212:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773824 00000100:00100000:0.0:1789479839.195217:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773824 00000100:00100000:0.0:1789479839.195234:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789479839.195239:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000773095d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+6:6497:x1876405527773824:12345-0@lo:101: 00010000:00010000:0.0:1789479839.195246:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479839.195256:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f092e93a/0xdaa289fda243cd79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cd72 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195270:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f092e93a/0xdaa289fda243cd79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cd72 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195450:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f092e93a/0xdaa289fda243cd79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cd72 expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195456:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f092e93a, rc 0) 00000100:00100000:0.0:1789479839.195497:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000773095d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+7:6497:x1876405527773824:12345-0@lo:101: Request processed in 258us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.195504:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789479839.195570:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773824:0@lo:101: 00010000:00010000:1.0:1789479839.195580:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195587:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.195598:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789479839.195610:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195616:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000004ea6492/0xdaa289fda243cd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.195622:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789479839.195625:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789479839.195629:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a6a83cfb000 10000000:01000000:1.0:1789479839.195631:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789479839.195634:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789479839.195636:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789479839.195648:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195655:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195661:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.195678:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773952:0@lo:101: 00000100:00100000:1.0:1789479839.195703:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.195719:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2364b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.195766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527773952 00000100:00100000:0.0:1789479839.195770:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527773952 00000100:00100000:0.0:1789479839.195787:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789479839.195791:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b27f4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+7:6497:x1876405527773952:12345-0@lo:101: 00010000:00010000:0.0:1789479839.195798:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479839.195805:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cd80 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195816:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195822:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.195828:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a4ff9384, rc 0) 00000100:00100000:0.0:1789479839.195864:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b27f4880 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+8:6497:x1876405527773952:12345-0@lo:101: Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.195869:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789479839.195929:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527773952:0@lo:101: 00010000:00010000:1.0:1789479839.195939:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.195945:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.195983:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774080:0@lo:501: 00000100:00100000:1.0:1789479839.196007:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.196026:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2364b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.196074:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774080 00000100:00100000:0.0:1789479839.196078:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774080 00000100:00100000:0.0:1789479839.196095:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479839.196107:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000766c59d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+8:6497:x1876405527774080:12345-0@lo:501: 00000100:00100000:0.0:1789479839.196392:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000766c59d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:6497:x1876405527774080:12345-0@lo:501: Request processed in 286us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.196399:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479839.196483:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774080:0@lo:501: 00000100:00100000:1.0:1789479839.196507:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774208:0@lo:503: 00000100:00100000:1.0:1789479839.196544:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.196563:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2364b3e going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.196601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774208 00000100:00100000:0.0:1789479839.196606:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774208 00000100:00100000:0.0:1789479839.196622:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789479839.196627:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a655525b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:6497:x1876405527774208:12345-0@lo:503: 00000100:00100000:0.0:1789479839.196770:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a655525b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:6497:x1876405527774208:12345-0@lo:503: Request processed in 142us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.196776:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789479839.196855:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774208:0@lo:503: 00000100:00100000:1.0:1789479839.197537:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6542:1876405527774336:0@lo:502: 00000100:00100000:1.0:1789479839.197579:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.197610:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a830055c going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.197658:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774336 00000100:00100000:0.0:1789479839.197664:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774336 00000100:00100000:0.0:1789479839.197691:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479839.197696:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a314668d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:6542:x1876405527774336:12345-0@lo:502: 00000100:00100000:0.0:1789479839.197784:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a314668d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:6542:x1876405527774336:12345-0@lo:502: Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.197791:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479839.197871:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6542:1876405527774336:0@lo:502: 00000020:01000000:1.0:1789479839.197894:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479839.197904:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479839.197911:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789479839.197916:0:6542:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789479839.197919:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789479839.197937:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000084f93a89) 00000020:00000080:1.0:1789479839.197953:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789479839.197959:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789479839.198035:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789479839.198043:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cd95 00000020:00000080:3.0:1789479839.200557:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789479839.200567:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479839.200573:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479839.200575:0:6542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789479839.200579:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479839.200583:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479839.200585:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789479839.200588:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789479839.200605:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000db9cbd5b) 00000020:00000080:3.0:1789479839.200624:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789479839.200628:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789479839.200629:0:6542:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789479839.200636:0:6542:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789479839.200642:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789479839.200709:0:6542:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001dcc58f2 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789479839.200718:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000aaef8cf4) 00000020:00000080:3.0:1789479839.200725:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789479839.200772:0:6542:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789479839.200777:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243cdaa 00000020:00000080:3.0:1789479839.200872:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789479839.200878:0:6542:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789479839.200883:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdaa289fda243cdb1 00080000:01000000:3.0:1789479839.200888:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789479839.200891:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cdb8 00080000:10000000:3.0:1789479839.201623:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789479839.201773:0:6542:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789479839.206028:0:6542:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789479839.267707:0:6542:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789479839.268532:0:6542:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789479839.271440:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789479839.271792:0:6542:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789479839.275142:0:6542:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001930560d) 00000020:00000080:0.0:1789479839.275164:0:6542:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789479839.275399:0:6542:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789479839.275407:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cdc6 00000020:00000080:1.0:1789479839.278630:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789479839.279874:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.289687:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.291784:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.294069:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.296745:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.299792:0:6542:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1789479839.302458:0:6542:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdaa289fda243cdcd 00000020:00000080:1.0:1789479839.302790:0:6542:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789479839.302803:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479839.302809:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479839.302811:0:6542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789479839.302813:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479839.302817:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479839.302818:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479839.302821:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479839.302823:0:6542:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789479839.302825:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479839.302827:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479839.302828:0:6542:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789479839.302830:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479839.302834:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479839.302835:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789479839.302840:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789479839.302880:0:6542:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789479839.302932:0:6542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6542:1876405527774464:0@lo:502: 00000100:00100000:1.0:1789479839.303002:0:6542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479839.303062:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774464 00000100:00100000:3.0:1789479839.303070:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774464 00000100:00100000:1.0:1789479839.303099:0:6542:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4c87fba going to sleep for 11 seconds 00000100:00100000:3.0:1789479839.303115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479839.303124:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004a607075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+9:6542:x1876405527774464:12345-0@lo:502: 00000100:00100000:3.0:1789479839.303306:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004a607075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+9:6542:x1876405527774464:12345-0@lo:502: Request processed in 183us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479839.303313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479839.303807:0:6542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004a1974a3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6542:1876405527774464:0@lo:502: 00000020:01000000:0.0:1789479839.303867:0:6542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479839.303872:0:6542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479839.303874:0:6542:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789479839.303878:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789479839.303990:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789479839.304012:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789479839.304030:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.304038:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.304044:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a83cfb000 from 1 10000000:01000000:1.0:1789479839.304046:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479839.304066:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.304070:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.304076:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.304086:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774592:0@lo:101: 00000100:00100000:1.0:1789479839.304111:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.304164:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f40488 going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.304223:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774592 00000100:00100000:2.0:1789479839.304227:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774592 00000100:00100000:2.0:1789479839.304264:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479839.304271:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5c18eb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+9:6497:x1876405527774592:12345-0@lo:101: 00010000:00010000:2.0:1789479839.304391:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479839.304404:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cdd4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.304439:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.304450:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.304456:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a898f1a7, rc 0) 00000100:00100000:2.0:1789479839.304541:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5c18eb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+10:6497:x1876405527774592:12345-0@lo:101: Request processed in 271us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.304548:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789479839.304562:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774592:0@lo:101: 00010000:00010000:1.0:1789479839.304575:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.304595:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.305128:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774720:0@lo:256: 00000100:00100000:1.0:1789479839.305164:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.305216:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f40488 going to sleep for 11 seconds 00000100:00100000:3.0:1789479839.305229:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774720 00000100:00100000:3.0:1789479839.305237:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774720 00000100:00100000:3.0:1789479839.305268:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479839.305275:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000036c2b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+10:6497:x1876405527774720:12345-0@lo:256: 20000000:01000000:3.0:1789479839.305289:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789479839.305294:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789479839.305677:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000036c2b8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+10:6497:x1876405527774720:12345-0@lo:256: Request processed in 402us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.305685:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789479839.305748:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774720:0@lo:256: 10000000:01000000:1.0:1789479839.306635:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789479839.306656:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.306667:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.306675:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a83cfb000 from 1 10000000:01000000:1.0:1789479839.306677:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789479839.306700:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.306707:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.306714:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.306727:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774848:0@lo:101: 00000100:00100000:1.0:1789479839.306756:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.307340:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f40488 going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.307344:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774848 00000100:00100000:2.0:1789479839.307350:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774848 00000100:00100000:2.0:1789479839.307392:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789479839.307400:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078398fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+10:6497:x1876405527774848:12345-0@lo:101: 00010000:00010000:2.0:1789479839.307410:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479839.307434:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cde2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.307453:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.307463:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.307469:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000186052c0, rc 0) 00000100:00100000:2.0:1789479839.307512:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078398fb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527774848:12345-0@lo:101: Request processed in 113us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.307518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789479839.307712:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774848:0@lo:101: 00010000:00010000:1.0:1789479839.307724:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.307730:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.307782:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774976:0@lo:501: 00000100:00100000:1.0:1789479839.307808:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.307829:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f40488 going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.308106:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527774976 00000100:00100000:2.0:1789479839.308111:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527774976 00000100:00100000:2.0:1789479839.308144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789479839.308150:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6048fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527774976:12345-0@lo:501: 00000100:00100000:2.0:1789479839.308346:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6048fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527774976:12345-0@lo:501: Request processed in 185us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.308354:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479839.308540:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527774976:0@lo:501: 00000100:00100000:1.0:1789479839.308568:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775104:0@lo:503: 00000100:00100000:1.0:1789479839.308604:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.308663:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012f40488 going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.308804:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775104 00000100:00100000:0.0:1789479839.308810:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775104 00000100:00100000:0.0:1789479839.308848:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789479839.308854:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac44d4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527775104:12345-0@lo:503: 00000040:00080000:0.0:1789479839.309030:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479839.309113:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac44d4aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527775104:12345-0@lo:503: Request processed in 259us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.309120:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789479839.309177:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775104:0@lo:503: 00000040:00080000:2.0:1789479839.310921:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789479839.311050:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789479839.311070:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789479839.311148:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.311160:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.311229:0:6497:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789479839.311232:0:6497:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6a83cfb000 10000000:01000000:1.0:1789479839.311235:0:6497:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6a83cfb000 10000000:01000000:1.0:1789479839.311239:0:6497:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789479839.311253:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a83cfb000 from 1 10000000:01000000:1.0:1789479839.311256:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789479839.311280:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.311296:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.311306:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.311431:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775232:0@lo:101: 00000100:00100000:1.0:1789479839.311474:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479839.311525:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775232 00000100:00100000:0.0:1789479839.311532:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775232 00000100:00100000:0.0:1789479839.311571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479839.311579:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000888fd075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+11:6497:x1876405527775232:12345-0@lo:101: 00010000:00010000:0.0:1789479839.311595:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479839.311606:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cdf0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.311632:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.311641:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479839.311648:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004b0b0356, rc 0) 00000100:00100000:1.0:1789479839.311670:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4c87fba going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.311682:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000888fd075 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527775232:12345-0@lo:101: Request processed in 103us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479839.311689:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775232:0@lo:101: 00000100:00100000:0.0:1789479839.311702:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789479839.311703:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.311712:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.311754:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775360:0@lo:501: 00000100:00100000:1.0:1789479839.311775:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.311789:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4c87fba going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.311802:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775360 00000100:00100000:0.0:1789479839.311806:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775360 00000100:00100000:0.0:1789479839.311829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479839.311835:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d1bd78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527775360:12345-0@lo:501: 00000100:00100000:0.0:1789479839.311998:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d1bd78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527775360:12345-0@lo:501: Request processed in 163us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.312005:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789479839.312079:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775360:0@lo:501: 00000100:00100000:1.0:1789479839.312105:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775488:0@lo:503: 00000100:00100000:1.0:1789479839.312139:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.312156:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4c87fba going to sleep for 11 seconds 00000100:00100000:0.0:1789479839.312222:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775488 00000100:00100000:0.0:1789479839.312226:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775488 00000100:00100000:0.0:1789479839.312250:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789479839.312256:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3b33036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527775488:12345-0@lo:503: 00000100:00100000:0.0:1789479839.312318:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3b33036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527775488:12345-0@lo:503: Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.312324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479839.312371:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b9122d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527775488:0@lo:503: 00000100:00100000:0.0:1789479839.312633:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6547:1876405527775616:0@lo:502: 00000100:00100000:0.0:1789479839.312655:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479839.312679:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016b75af1 going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.312746:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775616 00000100:00100000:2.0:1789479839.312750:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775616 00000100:00100000:2.0:1789479839.312781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479839.312798:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000083147e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6547:x1876405527775616:12345-0@lo:502: 00000100:00100000:2.0:1789479839.312871:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000083147e3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6547:x1876405527775616:12345-0@lo:502: Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.312877:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479839.312916:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6547:1876405527775616:0@lo:502: 00000020:01000004:0.0:1789479839.312964:0:6547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789479839.312977:0:6547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000256ed831) 00000020:00000080:0.0:1789479839.312994:0:6547:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789479839.313245:0:6547:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001dcc58f2 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789479839.313250:0:6547:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001dcc58f2 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789479839.313253:0:6547:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001dcc58f2 4 00010000:00080000:0.0:1789479839.313282:0:6547:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009915327a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789479839.315374:0:6547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789479839.315571:0:6547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789479839.315605:0:6547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789479839.315615:0:6547:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdaa289fda243ce05 00000100:00080000:2.0:1789479839.315624:0:6547:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789479839.315631:0:6547:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009915327a using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789479839.315658:0:6547:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000868d73b9 x1876405527775744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789479839.315685:0:6547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789479839.315927:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000868d73b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527775744:0@lo:38: 00000100:00100000:1.0:1789479839.316042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479839.316155:0:6547:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001581e403 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6547:1876405527775872:0@lo:502: 00000100:00100000:2.0:1789479839.316248:0:6547:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479839.316270:0:6547:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e980e82 going to sleep for 11 seconds 00000100:00100000:1.0:1789479839.316360:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775744 00000100:00100000:1.0:1789479839.316366:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775744 00000100:00100000:0.0:1789479839.316431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527775872 00000100:00100000:0.0:1789479839.316437:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527775872 00000100:00100000:1.0:1789479839.316459:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479839.316467:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000b9122d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527775744:12345-0@lo:38: 00000100:00100000:0.0:1789479839.316473:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789479839.316481:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000044416dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6547:x1876405527775872:12345-0@lo:502: 00000100:00100000:1.0:1789479839.316529:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000b9122d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527775744:12345-0@lo:38: Request processed in 61us (486us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789479839.316536:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479839.316579:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000044416dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6547:x1876405527775872:12345-0@lo:502: Request processed in 99us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479839.316587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479839.316655:0:6547:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001581e403 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:6547:1876405527775872:0@lo:502: 00000040:00080000:2.0:1789479839.316681:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789479839.316749:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789479839.316771:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1789479839.316789:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:0.0:1789479839.316793:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789479839.316795:0:3644:0:(import.c:65:import_set_state_nolock()) 000000009915327a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00010000:00010000:0.0:1789479839.316805:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789479839.316849:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789479839.316851:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479839.316853:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479839.316854:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479839.316855:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479839.316857:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479839.316858:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479839.316860:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479839.316861:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479839.316862:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479839.316864:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479839.316865:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479839.316868:0:6497:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789479839.316871:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789479839.316872:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479839.316873:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479839.316874:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479839.316875:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479839.316876:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479839.316880:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479839.316881:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479839.316882:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479839.316883:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479839.316884:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479839.316885:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479839.316895:0:6497:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789479839.316903:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527776000:0@lo:253: 00000100:00080000:1.0:1789479839.316923:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789479839.316927:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000868d73b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527775744:0@lo:38: 00000100:00100000:0.0:1789479839.316934:0:6497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479839.316958:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set 0000000081f878d9 going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.316988:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776000 00000100:00100000:2.0:1789479839.316993:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776000 00000100:00100000:2.0:1789479839.317019:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789479839.317026:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000078c4d65b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527776000:12345-0@lo:253: 20000000:01000000:2.0:1789479839.317043:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789479839.317056:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789479839.322795:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789479839.322870:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789479839.322992:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789479839.322997:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789479839.323015:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.323031:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.323109:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.323142:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479839.323156:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000078c4d65b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6497:x1876405527776000:12345-0@lo:253: Request processed in 6129us (6221us total) trans 0 rc 0/0 00010000:00010000:1.0:1789479839.323161:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479839.323176:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479839.323187:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f00ef537 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527776128:0@lo:104: 00000100:00100000:0.0:1789479839.323215:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:6497:1876405527776000:0@lo:253: 10000000:01000000:0.0:1789479839.323229:0:6497:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789479839.323233:0:6497:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479839.323236:0:6497:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789479839.323238:0:6497:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479839.323239:0:6497:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479839.323241:0:6497:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479839.323242:0:6497:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479839.323243:0:6497:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479839.323245:0:6497:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789479839.323247:0:6497:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479839.323249:0:6497:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479839.323250:0:6497:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479839.323252:0:6497:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479839.323264:0:6497:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1789479839.323269:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.323321:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a4c87fba going to sleep for 11 seconds 00000100:00100000:2.0:1789479839.323331:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776128 00000100:00100000:2.0:1789479839.323338:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776128 00000100:00100000:2.0:1789479839.323378:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479839.323386:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1479789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527776128:12345-0@lo:104: 00010000:00010000:2.0:1789479839.323396:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479839.323453:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479839.323459:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1479789 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527776128:12345-0@lo:104: Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479839.323466:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479839.323478:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f00ef537 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527776128:0@lo:104: 00010000:00010000:1.0:1789479839.323492:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324405:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789479839.324412:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324434:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007deb4c9c already unused, calling callback (00000000680b9bb4) 10000000:00010000:1.0:1789479839.324438:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324445:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479839.324451:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479839.324457:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479839.324492:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324499:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479839.324521:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324541:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000007deb4c9c/0xdaa289fda243cdd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cddb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.324556:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479839.324559:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479839.324560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479839.324754:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479839.324764:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f00ef537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527776256:0@lo:103: 00000100:00100000:2.0:1789479839.324808:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479839.325152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776256 00000100:00100000:1.0:1789479839.325158:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776256 00010000:00010000:1.0:1789479839.325177:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479839.325529:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479839.325538:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001581e403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+12:3645:x1876405527776256:12345-0@lo:103: 00010000:00010000:1.0:1789479839.325550:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479839.325554:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325565:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325578:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a898f1a7/0xdaa289fda243cddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cdd4 expref: 12 pid: 6514 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325590:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325598:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789479839.325622:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002625747s 00010000:00010000:1.0:1789479839.325626:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325632:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325637:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325643:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325648:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e30abd47 already unused, calling callback (000000007e7d2c58) 00010000:00010000:1.0:1789479839.325651:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325656:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325678:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479839.325687:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479839.325727:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001581e403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+11:3645:x1876405527776256:12345-0@lo:103: Request processed in 191us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479839.325735:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789479839.325783:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479839.325801:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479839.325807:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e30abd47/0xdaa289fda243ce0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479839.325861:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f00ef537 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527776256:0@lo:103: 00080000:10000000:2.0:1789479839.328871:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1789479839.329299:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789479839.329549:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1789479839.329681:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789479839.329831:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1789479839.330134:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789479839.330772:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.330921:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789479839.331068:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.332054:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789479839.332762:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1789479839.332921:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789479839.336180:0:6497:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789479839.353946:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789479839.356434:0:6553:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789479839.360473:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789479839.360621:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789479839.361057:0:6497:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789479839.361064:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1789479839.361243:0:6552:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789479839.361247:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1789479839.361825:0:6553:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479839.363493:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479839.364967:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789479839.365897:0:6497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789479839.366010:0:6497:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789479839.367896:0:6497:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789479839.368298:0:6497:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1789479839.368886:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789479839.369044:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789479839.369220:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789479839.369367:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789479839.369523:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789479839.369654:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789479839.369805:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789479839.369946:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789479839.370076:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789479839.370242:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789479839.370362:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789479839.370494:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789479839.370578:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789479839.370660:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789479839.370754:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789479839.370853:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789479839.371134:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789479839.371286:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000040:00080000:2.0:1789479839.371327:0:6553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:0.0:1789479839.371384:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000004:00080000:2.0:1789479839.371397:0:6553:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789479839.371407:0:6553:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1789479839.371551:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789479839.371679:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789479839.371839:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789479839.371964:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789479839.372104:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789479839.372276:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789479839.372443:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789479839.372576:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789479839.372711:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789479839.372832:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789479839.372982:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789479839.373151:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789479839.373318:0:6497:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789479839.373505:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1789479839.376904:0:6497:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789479839.376941:0:6497:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c0c01c37988 00100000:10000000:2.0:1789479839.376949:0:6497:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789479839.378043:0:6497:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789479839.378055:0:6497:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789479839.378072:0:6497:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789479839.378084:0:6497:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789479839.378931:0:6497:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789479839.379700:0:6497:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789479840.005303:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479841.028722:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479842.057527:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479843.076335:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479843.531668:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789479844.101554:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789479844.549922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789479844.549930:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789479844.549933:0:8:0:(import.c:65:import_set_state_nolock()) 000000009915327a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789479844.549946:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009915327a using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789479844.550095:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a404257 x1876405527776512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789479844.550475:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098ad2603 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527776384:0@lo:400: 00000100:00100000:0.0:1789479844.550535:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479844.550591:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776384 00000100:00100000:0.0:1789479844.550599:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776384 00000100:00100000:0.0:1789479844.550633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479844.550640:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bda7c49a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+11:3647:x1876405527776384:12345-0@lo:400: 00000100:00100000:0.0:1789479844.550682:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bda7c49a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+11:3647:x1876405527776384:12345-0@lo:400: Request processed in 43us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479844.550689:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479844.550731:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098ad2603 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527776384:0@lo:400: 00000100:00100000:1.0:1789479844.552340:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a404257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527776512:0@lo:38: 00000100:00100000:1.0:1789479844.552427:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479844.553646:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776512 00000100:00100000:2.0:1789479844.553657:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776512 00000100:00100000:2.0:1789479844.553732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479844.553739:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed55b808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527776512:12345-0@lo:38: 00010000:00080000:2.0:1789479844.553792:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1789479844.553840:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdaa289fda243ce13 00000004:00100000:2.0:1789479844.553883:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789479844.553997:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000cfffe503 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479844.554071:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed55b808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876405527776512:12345-0@lo:38: Request processed in 331us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479844.554077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789479844.554144:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000a404257 x1876405527776512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789479844.554160:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789479844.554167:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789479844.554171:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789479844.554172:0:3644:0:(import.c:65:import_set_state_nolock()) 000000009915327a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479844.554177:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a404257 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527776512:0@lo:38: 00000020:00000004:1.0:1789479844.585642:0:6850:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479844.585805:0:6850:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789479845.125246:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479846.148433:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479847.173347:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479848.199182:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789479848.311993:0:6951:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479848.313372:0:6951:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789479849.156991:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789479849.156999:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a83cfb000 from 3 10000000:01000000:2.0:1789479849.157003:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789479849.157047:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479849.157073:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479849.157084:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479849.157105:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ccfc0e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527776640:0@lo:101: 00000100:00100000:2.0:1789479849.157164:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479849.157331:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d45f7d3 going to sleep for 11 seconds 00000100:00100000:0.0:1789479849.157452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776640 00000100:00100000:0.0:1789479849.157460:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776640 00000100:00100000:0.0:1789479849.157511:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789479849.157519:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054017e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+11:6517:x1876405527776640:12345-0@lo:101: 00010000:00010000:0.0:1789479849.157531:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479849.157542:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ce1a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479849.157589:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479849.157599:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479849.157607:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001608db33, rc 0) 00000100:00100000:0.0:1789479849.157660:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054017e92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:6517:x1876405527776640:12345-0@lo:101: Request processed in 143us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479849.157667:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789479849.158702:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ccfc0e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527776640:0@lo:101: 00010000:00010000:2.0:1789479849.158717:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479849.158727:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479849.158772:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ccfc0e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527776768:0@lo:256: 00000100:00100000:2.0:1789479849.158804:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479849.158828:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d45f7d3 going to sleep for 11 seconds 00000100:00100000:0.0:1789479849.159135:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776768 00000100:00100000:0.0:1789479849.159141:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776768 00000100:00100000:0.0:1789479849.159246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789479849.159254:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b18959f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6517:x1876405527776768:12345-0@lo:256: 20000000:01000000:0.0:1789479849.159270:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789479849.159285:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789479849.159288:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789479849.159395:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b18959f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:6517:x1876405527776768:12345-0@lo:256: Request processed in 141us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479849.159403:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789479849.167822:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ccfc0e9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527776768:0@lo:256: 10000000:01000000:2.0:1789479849.167889:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789479849.167898:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479849.167908:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479849.223066:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479849.672122:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479849.672145:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000060d2268d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527776896:0@lo:400: 00000100:00100000:3.0:1789479849.672234:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479849.672453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527776896 00000100:00100000:1.0:1789479849.672461:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527776896 00000100:00100000:1.0:1789479849.672509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479849.672515:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000387f971b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527776896:12345-0@lo:400: 00000100:00100000:1.0:1789479849.672561:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000387f971b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527776896:12345-0@lo:400: Request processed in 46us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479849.672567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789479849.672597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000060d2268d x1876405527776896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479849.672609:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000060d2268d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527776896:0@lo:400: 00010000:00010000:3.0:1789479850.245473:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479851.272312:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479852.298791:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479853.317395:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479854.341666:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479854.788932:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ecf3546 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527777152:0@lo:400: 00000100:00100000:3.0:1789479854.789007:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479854.789060:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789479854.789066:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527777024:0@lo:400: 00000100:00100000:3.0:1789479854.789089:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479854.789121:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777024 00000100:00100000:3.0:1789479854.789128:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777024 00000100:00100000:3.0:1789479854.789165:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479854.789171:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bb58548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+12:3646:x1876405527777024:12345-0@lo:400: 00000100:00100000:3.0:1789479854.789244:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bb58548 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+12:3646:x1876405527777024:12345-0@lo:400: Request processed in 73us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479854.789252:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479854.789300:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087235487 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527777024:0@lo:400: 00000100:00100000:0.0:1789479854.789430:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777152 00000100:00100000:0.0:1789479854.789435:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777152 00000100:00100000:0.0:1789479854.789472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479854.789488:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008217240b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527777152:12345-0@lo:400: 00000100:00100000:0.0:1789479854.789524:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008217240b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527777152:12345-0@lo:400: Request processed in 37us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479854.789535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789479854.789864:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001ecf3546 x1876405527777152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479854.789875:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ecf3546 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527777152:0@lo:400: 00010000:00010000:3.0:1789479855.365104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479856.388530:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479857.412561:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479858.438257:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479859.461434:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479859.912477:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7422f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527777280:0@lo:400: 00000100:00100000:2.0:1789479859.912584:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479859.912662:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479859.912668:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527777408:0@lo:400: 00000100:00100000:2.0:1789479859.912715:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479859.912766:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777408 00000100:00100000:2.0:1789479859.912775:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777408 00000100:00100000:2.0:1789479859.912828:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479859.912837:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ccfc0e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527777408:12345-0@lo:400: 00000100:00100000:2.0:1789479859.912896:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ccfc0e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527777408:12345-0@lo:400: Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479859.912903:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789479859.912948:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000090a1a8f7 x1876405527777408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479859.912964:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527777408:0@lo:400: 00000100:00100000:0.0:1789479859.913083:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777280 00000100:00100000:0.0:1789479859.913088:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777280 00000100:00100000:0.0:1789479859.913135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789479859.913142:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000577bfc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:3647:x1876405527777280:12345-0@lo:400: 00000100:00100000:0.0:1789479859.913183:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000577bfc66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+12:3647:x1876405527777280:12345-0@lo:400: Request processed in 42us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479859.913216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789479859.913272:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7422f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527777280:0@lo:400: 00010000:00010000:0.0:1789479860.496244:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789479861.188867:0:7450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789479861.188871:0:7450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789479861.188872:0:7450:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789479861.188978:0:7450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e8a4566e 00000020:01000004:1.0:1789479861.188991:0:7450:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789479861.189001:0:7450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789479861.189013:0:7450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000084163864) 00000020:00000080:1.0:1789479861.189026:0:7450:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789479861.331424:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789479861.331501:0:7450:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1789479861.414798:0:7450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789479861.415003:0:7450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1789479861.415013:0:7450:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789479861.415023:0:7450:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243ce2f 00000020:01000004:1.0:1789479861.415028:0:7450:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789479861.415046:0:7450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789479861.415049:0:7450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789479861.415054:0:7450:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1789479861.415075:0:7450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1789479861.415083:0:7450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789479861.486384:0:7450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789479861.486422:0:7450:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20061 00000020:01000004:3.0:1789479861.486425:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789479861.486427:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789479861.486428:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479861.486430:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479861.486431:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479861.486432:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479861.486433:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789479861.486731:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479861.486735:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479861.486737:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479861.486738:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479861.486741:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:3.0:1789479861.486744:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789479861.486746:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789479861.486747:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789479861.486748:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789479861.486749:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789479861.486750:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789479861.486751:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789479861.486753:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789479861.486754:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789479861.486755:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789479861.486756:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789479861.486781:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789479861.486797:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527777536:0@lo:253: 00000100:00100000:3.0:1789479861.486860:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.486964:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1751db4 going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.487302:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777536 00000100:00100000:2.0:1789479861.487320:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777536 00000100:00100000:2.0:1789479861.487369:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479861.487377:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7837e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527777536:12345-0@lo:253: 20000000:01000000:2.0:1789479861.487405:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789479861.487409:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789479861.487413:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789479861.487416:0:6512:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789479861.487458:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789479861.487827:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479861.487935:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789479861.487955:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479861.487974:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789479861.487988:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789479861.488002:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789479861.488059:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789479861.488067:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789479861.488079:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789479861.488084:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789479861.488093:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789479861.488097:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789479861.488107:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789479861.488118:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789479861.488324:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789479861.488334:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789479861.488347:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789479861.488352:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479861.488364:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789479861.488370:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1789479861.488382:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789479861.488388:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789479861.488400:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789479861.488415:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789479861.488426:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789479861.491695:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789479861.491714:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789479861.491725:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789479861.491738:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789479861.491752:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789479861.491757:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789479861.491787:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789479861.491812:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789479861.491818:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789479861.491844:0:6512:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789479861.491851:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1789479861.496889:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789479861.497109:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789479861.497134:0:6512:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:3.0:1789479861.497137:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789479861.497154:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789479861.497159:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789479861.497171:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789479861.497176:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:3.0:1789479861.497225:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789479861.497234:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789479861.497249:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789479861.497265:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789479861.497338:0:6512:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789479861.497347:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789479861.497905:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789479861.498044:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789479861.498060:0:6512:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.144@tcp for mdt 20000000:01000000:0.0:1789479861.498062:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:0.0:1789479861.498076:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789479861.498081:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789479861.498093:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789479861.498098:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:0.0:1789479861.498109:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789479861.498115:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789479861.498128:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789479861.498141:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789479861.498159:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789479861.498162:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789479861.498165:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789479861.498252:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789479861.498254:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479861.498913:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479861.498935:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479861.498946:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789479861.499148:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789479861.499167:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789479861.499182:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789479861.499287:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789479861.499290:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479861.499908:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479861.499930:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479861.499946:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789479861.500864:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789479861.500888:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789479861.500912:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789479861.500921:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789479861.500923:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789479861.501417:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789479861.501560:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789479861.501584:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789479861.501742:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789479861.501762:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789479861.501778:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789479861.501791:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789479861.501793:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789479861.501798:0:6512:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789479861.501803:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789479861.502075:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1789479861.502155:0:6512:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 00010000:00010000:0.0:1789479861.508433:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789479861.511992:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479861.512092:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512111:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512118:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512124:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512130:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512168:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512219:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.512233:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7422f68 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527777664:0@lo:104: 00000100:00100000:0.0:1789479861.512292:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479861.512804:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.512813:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 12 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.512822:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527777792:0@lo:104: 00000100:00100000:0.0:1789479861.512844:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.513570:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777664 00000100:00100000:3.0:1789479861.513578:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777664 00000100:00100000:3.0:1789479861.513610:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777792 00000100:00100000:3.0:1789479861.513612:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777792 00000100:00100000:3.0:1789479861.513625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479861.513631:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087672df9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527777664:12345-0@lo:104: 00010000:00010000:3.0:1789479861.513643:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513693:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479861.513698:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087672df9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527777664:12345-0@lo:104: Request processed in 67us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.513703:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479861.513717:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479861.513721:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036cc44ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527777792:12345-0@lo:104: 00010000:00010000:3.0:1789479861.513726:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513756:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789479861.513760:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036cc44ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527777792:12345-0@lo:104: Request processed in 40us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.513765:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789479861.513780:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479861.513785:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513791:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009ac1d6ed already unused, calling callback (00000000680b9bb4) 10000000:00010000:3.0:1789479861.513802:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513809:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479861.513814:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479861.513819:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479861.513847:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513854:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479861.513868:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513874:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cdf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cdf7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513886:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479861.513888:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513894:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003dbfd1b4 already unused, calling callback (00000000680b9bb4) 10000000:00010000:3.0:1789479861.513896:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513902:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479861.513917:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479861.513923:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479861.513936:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513941:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479861.513946:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513951:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cd80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.513959:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.513961:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479861.513962:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479861.513981:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527778048:0@lo:103: 00000100:00100000:3.0:1789479861.514010:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479861.514079:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479861.514089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fedf66b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527777920:0@lo:103: 00000100:00100000:1.0:1789479861.514114:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479861.514266:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.514277:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 12 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.514285:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ea3b4dbf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527778176:0@lo:104: 00000100:00100000:0.0:1789479861.514329:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.514348:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set 00000000571df573 going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.514367:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7422f68 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527777664:0@lo:104: 00000100:00100000:0.0:1789479861.514375:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527777792:0@lo:104: 00000100:00100000:1.0:1789479861.514720:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778048 00000100:00100000:1.0:1789479861.514725:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778048 00010000:00010000:1.0:1789479861.514744:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 13 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.514797:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527777920 00000100:00100000:1.0:1789479861.514801:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527777920 00010000:00010000:1.0:1789479861.514811:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 14 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.514859:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778176 00000100:00100000:2.0:1789479861.514863:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778176 00000100:00100000:2.0:1789479861.514880:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479861.514885:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd03f3de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527778176:12345-0@lo:104: 00010000:00010000:2.0:1789479861.514892:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.514932:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479861.514936:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd03f3de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527778176:12345-0@lo:104: Request processed in 52us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.514942:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789479861.514981:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479861.514989:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c99c4a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+14:3646:x1876405527778048:12345-0@lo:103: 00010000:00010000:0.0:1789479861.514998:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479861.515009:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515017:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515028:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a4ff9384/0xdaa289fda243cd87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cd80 expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515039:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479861.515080:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c99c4a35 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+13:3646:x1876405527778048:12345-0@lo:103: Request processed in 93us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.515086:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479861.515100:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479861.515106:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d2268d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+12:3645:x1876405527777920:12345-0@lo:103: 00010000:00010000:0.0:1789479861.515113:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479861.515117:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515124:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515133:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004b0b0356/0xdaa289fda243cdf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cdf0 expref: 12 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.515140:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479861.515165:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d2268d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+11:3645:x1876405527777920:12345-0@lo:103: Request processed in 60us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.515170:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479861.515234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fedf66b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527777920:0@lo:103: 00010000:00010000:2.0:1789479861.515657:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789479861.515661:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.515668:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c267d315 already unused, calling callback (00000000680b9bb4) 10000000:00010000:2.0:1789479861.515680:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.515686:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479861.515692:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479861.515697:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479861.515736:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.515743:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479861.515759:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.515765:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000c267d315/0xdaa289fda243cd64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cd6b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.515777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479861.515779:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479861.515780:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479861.515789:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afe493b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527778304:0@lo:103: 00000100:00100000:2.0:1789479861.515818:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.515859:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ea3b4dbf pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527778176:0@lo:104: 00010000:00010000:2.0:1789479861.515878:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.516012:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778304 00000100:00100000:1.0:1789479861.516016:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778304 00010000:00010000:1.0:1789479861.516031:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 11 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.516053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789479861.516059:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bd7e3fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+11:3647:x1876405527778304:12345-0@lo:103: 00010000:00010000:1.0:1789479861.516155:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479861.516160:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 11 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516169:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 11 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516178:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da9f9523/0xdaa289fda243cd6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cd64 expref: 11 pid: 6514 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516229:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516236:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516248:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516254:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516260:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516265:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516270:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028ca9067 already unused, calling callback (000000007e7d2c58) 00010000:00010000:1.0:1789479861.516272:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516278:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516292:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.516392:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479861.516431:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bd7e3fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+10:3647:x1876405527778304:12345-0@lo:103: Request processed in 372us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.516525:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afe493b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527778304:0@lo:103: 00000100:00100000:1.0:1789479861.516567:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789479861.516629:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.516637:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.516643:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028ca9067/0xdaa289fda243ce36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789479861.516656:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789479861.518636:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7837e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:7450:x1876405527777536:12345-0@lo:253: Request processed in 31256us (31772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.518658:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789479861.518739:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527777536:0@lo:253: 10000000:01000000:0.0:1789479861.518752:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789479861.518754:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479861.518756:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789479861.518758:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479861.518759:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789479861.518760:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479861.518761:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479861.518762:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479861.518764:0:7450:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789479861.518765:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479861.518766:0:7450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789479861.518781:0:7450:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e8a4566e from lustre-MDT0001 10000000:01000000:0.0:1789479861.518807:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789479861.518809:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789479861.518815:0:7450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a6a95c999c0 local copy 10000000:01000000:0.0:1789479861.518818:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789479861.518842:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.518851:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.518859:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.518872:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778432:0@lo:101: 00000100:00100000:0.0:1789479861.518899:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.518922:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c92f72d going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.518962:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778432 00000100:00100000:2.0:1789479861.518967:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778432 00000100:00100000:2.0:1789479861.518998:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479861.519004:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e15a5a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+9:7450:x1876405527778432:12345-0@lo:101: 00010000:00010000:2.0:1789479861.519015:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479861.519026:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003815ba57/0xdaa289fda243ce44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ce3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.519046:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003815ba57/0xdaa289fda243ce44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ce3d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.519055:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003815ba57/0xdaa289fda243ce44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce3d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.519062:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003815ba57, rc 0) 00000100:00100000:2.0:1789479861.519147:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e15a5a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+10:7450:x1876405527778432:12345-0@lo:101: Request processed in 143us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.519154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789479861.519519:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527778048:0@lo:103: 00000100:00100000:1.0:1789479861.521241:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778432:0@lo:101: 00010000:00010000:1.0:1789479861.521261:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.521273:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.521628:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778560:0@lo:501: 00000100:00100000:0.0:1789479861.521688:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.521722:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be54f032 going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.521833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778560 00000100:00100000:2.0:1789479861.521840:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778560 00000100:00100000:2.0:1789479861.521911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479861.521920:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a0231dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+10:7450:x1876405527778560:12345-0@lo:501: 00000100:00100000:2.0:1789479861.522029:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a0231dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+10:7450:x1876405527778560:12345-0@lo:501: Request processed in 109us (341us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789479861.522037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789479861.522549:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778560:0@lo:501: 10000000:01000000:0.0:1789479861.522565:0:7450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789479861.522585:0:7450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789479861.522590:0:7450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.522597:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.522603:0:7450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.522627:0:7450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789479861.522646:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6a866ce000 10000000:01000000:0.0:1789479861.522651:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789479861.522655:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a6a95c999c0 10000000:01000000:0.0:1789479861.522658:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789479861.522661:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a6a95c999c0 from 1 10000000:01000000:0.0:1789479861.522663:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789479861.522684:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.522691:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.522699:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.522722:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778688:0@lo:101: 00000100:00100000:0.0:1789479861.522750:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.522815:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c92f72d going to sleep for 11 seconds 00010000:00010000:1.0:1789479861.522864:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789479861.522869:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.522876:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002f1d5bf6 already unused, calling callback (00000000680b9bb4) 10000000:00010000:1.0:1789479861.522879:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.522885:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479861.522890:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479861.522895:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789479861.522911:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.522917:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479861.522941:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.522958:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243ce3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243ce44 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.522974:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479861.522975:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479861.522977:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479861.522985:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479861.522995:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527778816:0@lo:103: 00000100:00100000:1.0:1789479861.523023:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479861.523052:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778816 00000100:00100000:1.0:1789479861.523057:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778816 00000100:00100000:1.0:1789479861.523101:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479861.523108:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed882954 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+10:3647:x1876405527778816:12345-0@lo:103: 00010000:00010000:1.0:1789479861.523118:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479861.523128:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003815ba57/0xdaa289fda243ce44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243ce3d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.523140:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479861.523167:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed882954 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+9:3647:x1876405527778816:12345-0@lo:103: Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.523173:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479861.523221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527778816:0@lo:103: 00000100:00100000:2.0:1789479861.523587:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778688 00000100:00100000:2.0:1789479861.523591:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778688 00000100:00100000:2.0:1789479861.523631:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789479861.523637:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e2538bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+9:7450:x1876405527778688:12345-0@lo:101: 00010000:00010000:2.0:1789479861.523646:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479861.523656:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028252e79/0xdaa289fda243ce52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ce4b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.523672:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028252e79/0xdaa289fda243ce52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ce4b expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.523680:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028252e79/0xdaa289fda243ce52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce4b expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.523687:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028252e79, rc 0) 00000100:00100000:2.0:1789479861.523726:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e2538bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+10:7450:x1876405527778688:12345-0@lo:101: Request processed in 90us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.523732:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789479861.523798:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778688:0@lo:101: 00010000:00010000:1.0:1789479861.523810:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.523827:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479861.523842:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789479861.523859:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.523866:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000040a3675c/0xdaa289fda243ce4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479861.523873:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a6a866ce000 10000000:01000000:1.0:1789479861.523877:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789479861.523879:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a6a866ce000 from 1 10000000:01000000:1.0:1789479861.523881:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789479861.523896:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.523902:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.523908:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.523918:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778944:0@lo:101: 00000100:00100000:1.0:1789479861.523941:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479861.523954:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000009543977d going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.524002:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527778944 00000100:00100000:2.0:1789479861.524006:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527778944 00000100:00100000:2.0:1789479861.524022:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789479861.524027:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea181a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+10:7450:x1876405527778944:12345-0@lo:101: 00010000:00010000:2.0:1789479861.524033:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479861.524040:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a898f1a7/0xdaa289fda243ce60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ce59 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.524052:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a898f1a7/0xdaa289fda243ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ce59 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.524059:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a898f1a7/0xdaa289fda243ce60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce59 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.524135:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a898f1a7, rc 0) 00000100:00100000:2.0:1789479861.524172:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea181a1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+11:7450:x1876405527778944:12345-0@lo:101: Request processed in 144us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.524178:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479861.524294:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527778944:0@lo:101: 00010000:00010000:1.0:1789479861.524371:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.524384:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479861.524395:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789479861.524406:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.524412:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000450fc4c2/0xdaa289fda243ce59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479861.524417:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789479861.524420:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789479861.524424:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a6a866ce000 10000000:01000000:1.0:1789479861.524426:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789479861.524429:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789479861.524431:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789479861.524512:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.524519:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.524525:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.524535:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779072:0@lo:101: 00000100:00100000:1.0:1789479861.524559:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479861.524581:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000009543977d going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.524625:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779072 00000100:00100000:0.0:1789479861.524630:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779072 00000100:00100000:0.0:1789479861.524659:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479861.524665:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c52a4c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+11:7450:x1876405527779072:12345-0@lo:101: 00010000:00010000:0.0:1789479861.524673:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479861.524680:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e13579f7/0xdaa289fda243ce6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ce67 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.524693:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e13579f7/0xdaa289fda243ce6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.524699:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e13579f7/0xdaa289fda243ce6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.524705:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e13579f7, rc 0) 00000100:00100000:0.0:1789479861.524733:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c52a4c9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779072:12345-0@lo:101: Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.524739:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789479861.524830:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779072:0@lo:101: 00010000:00010000:1.0:1789479861.524840:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.524846:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479861.524923:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779200:0@lo:501: 00000100:00100000:1.0:1789479861.524946:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479861.524997:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000009543977d going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.525050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779200 00000100:00100000:0.0:1789479861.525054:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779200 00000100:00100000:0.0:1789479861.525173:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789479861.525183:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009dd0b185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779200:12345-0@lo:501: 00000100:00100000:0.0:1789479861.525371:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009dd0b185 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779200:12345-0@lo:501: Request processed in 120us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.525388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479861.525639:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000070681ea2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779200:0@lo:501: 00000100:00100000:2.0:1789479861.525668:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779328:0@lo:503: 00000100:00100000:2.0:1789479861.525708:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.525737:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000001871e7b5 going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.525788:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779328 00000100:00100000:0.0:1789479861.525794:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779328 00000100:00100000:0.0:1789479861.525824:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789479861.525829:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027d19bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779328:12345-0@lo:503: 00000100:00100000:0.0:1789479861.525907:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027d19bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779328:12345-0@lo:503: Request processed in 77us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.525913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789479861.526010:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779328:0@lo:503: 00000040:00080000:2.0:1789479861.526268:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789479861.526623:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779456:0@lo:502: 00000100:00100000:2.0:1789479861.526660:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.526720:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c8ce2e3 going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.526776:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779456 00000100:00100000:0.0:1789479861.526781:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779456 00000100:00100000:0.0:1789479861.526813:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789479861.526819:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000425d35e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779456:12345-0@lo:502: 00000100:00100000:0.0:1789479861.526894:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000425d35e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779456:12345-0@lo:502: Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.526900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789479861.526966:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779456:0@lo:502: 00000040:00080000:2.0:1789479861.527135:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789479861.527157:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1789479861.527171:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1789479861.527185:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1789479861.527229:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1789479861.527241:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1789479861.527256:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1789479861.527270:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1789479861.527285:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1789479861.527297:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1789479861.527332:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1789479861.527343:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1789479861.527369:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1789479861.527384:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1789479861.527396:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1789479861.527409:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1789479861.527423:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1789479861.527433:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1789479861.527583:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1789479861.527597:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1789479861.527609:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1789479861.527621:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1789479861.527655:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1789479861.527676:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779584:0@lo:502: 00000100:00100000:2.0:1789479861.527712:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.527731:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c8ce2e3 going to sleep for 11 seconds 00000100:00100000:0.0:1789479861.527854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779584 00000100:00100000:0.0:1789479861.527859:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779584 00000100:00100000:0.0:1789479861.527880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789479861.527885:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ecf7a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779584:12345-0@lo:502: 00000100:00100000:0.0:1789479861.527954:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ecf7a24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779584:12345-0@lo:502: Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.527961:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789479861.528035:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000415aa430 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779584:0@lo:502: 00000040:00080000:2.0:1789479861.528084:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1789479861.528092:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789479861.528695:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479861.528705:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479861.528707:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789479861.528712:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789479861.528715:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479861.528733:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000000b9a4642) 00000020:00000080:2.0:1789479861.528751:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789479861.528757:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789479861.528831:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789479861.528845:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243ce7c 00000020:00000080:2.0:1789479861.529030:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789479861.529035:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479861.529038:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479861.529039:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789479861.529048:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479861.529051:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479861.529053:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789479861.529056:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479861.529062:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000cbe5ac26) 00000020:00000080:2.0:1789479861.529186:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789479861.529388:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789479861.529390:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789479861.529392:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789479861.529398:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789479861.529547:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e8a4566e from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789479861.529558:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000007a961960) 00000020:00000080:2.0:1789479861.529566:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789479861.529611:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789479861.529615:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243ce91 00000020:00000080:2.0:1789479861.529701:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789479861.529707:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789479861.529711:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdaa289fda243ce98 00080000:01000000:2.0:1789479861.529716:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789479861.529719:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243ce9f 00080000:10000000:2.0:1789479861.530026:0:7462:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789479861.530415:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789479861.727622:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789479861.727835:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789479861.745961:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789479861.747550:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789479861.787371:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789479861.787384:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479861.787658:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479861.787662:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789479861.787667:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479861.787673:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479861.787674:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789479861.787688:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789479861.787693:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:0.0:1789479861.787717:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789479861.787731:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000fd0be3f3) 00000020:00000080:0.0:1789479861.787763:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789479861.787770:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789479861.787851:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789479861.787857:0:7462:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789479861.787864:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243cead 00010000:00080000:0.0:1789479861.787892:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000087db4667@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789479861.791780:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789479861.793402:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789479861.793417:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789479861.793465:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789479861.793487:0:7462:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243ceb4 00000100:00080000:1.0:1789479861.793497:0:7462:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479861.793507:0:7462:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000087db4667 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789479861.793538:0:7462:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005acf7335 x1876405527779712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479861.793561:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789479861.793979:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f74e30bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527779840:0@lo:400: 00000100:00100000:0.0:1789479861.794043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.794288:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005acf7335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527779712:0@lo:38: 00000100:00100000:2.0:1789479861.794333:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.794405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779712 00000100:00100000:0.0:1789479861.794412:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779712 00000100:00100000:0.0:1789479861.794449:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479861.794454:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000415aa430 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876405527779712:12345-0@lo:38: 00010000:00080000:0.0:1789479861.794476:0:6525:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1789479861.794517:0:6525:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243cebb 00000004:00100000:0.0:1789479861.794531:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789479861.794535:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1789479861.794688:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479861.794693:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794695:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789479861.794706:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789479861.794709:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789479861.794711:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789479861.794712:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789479861.794713:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789479861.794716:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794717:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789479861.794719:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479861.794724:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794725:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789479861.794729:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789479861.794766:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789479861.794779:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479861.794782:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794783:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789479861.794786:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479861.794788:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794789:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479861.794792:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479861.794793:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789479861.794814:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479861.794818:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479861.794819:0:7462:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479861.794822:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1789479861.795219:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779840 00000100:00100000:3.0:1789479861.795225:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779840 00000100:00100000:3.0:1789479861.795254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479861.795260:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001a7ae205 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527779840:12345-0@lo:400: 00000100:00100000:3.0:1789479861.795324:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001a7ae205 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527779840:12345-0@lo:400: Request processed in 64us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.795339:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789479861.795378:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f74e30bf x1876405527779840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479861.795391:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f74e30bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527779840:0@lo:400: 00000020:01000000:0.0:1789479861.795612:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789479861.795640:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789479861.795660:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.795670:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000008551760c/0xdaa289fda243ce67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479861.795677:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a866ce000 from 1 10000000:01000000:0.0:1789479861.795686:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789479861.795709:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.795715:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479861.795723:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479861.795737:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000995535b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779968:0@lo:101: 00000100:00100000:0.0:1789479861.795766:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.795801:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0783947 going to sleep for 11 seconds 00000100:00100000:3.0:1789479861.796698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527779968 00000100:00100000:3.0:1789479861.796705:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527779968 00000100:00100000:3.0:1789479861.796742:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479861.796749:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a076a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+12:7450:x1876405527779968:12345-0@lo:101: 00010000:00010000:3.0:1789479861.796761:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479861.796772:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cec2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.796792:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.796801:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.796809:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4da8e39, rc 0) 00000100:00100000:3.0:1789479861.796848:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a076a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+13:7450:x1876405527779968:12345-0@lo:101: Request processed in 100us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.796855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479861.796914:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000995535b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527779968:0@lo:101: 00010000:00010000:3.0:1789479861.796944:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.796953:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479861.797533:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780096:0@lo:256: 00000100:00100000:3.0:1789479861.797570:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.797594:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccb60bf1 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.797722:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780096 00000100:00100000:1.0:1789479861.797728:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780096 00000100:00100000:1.0:1789479861.797756:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789479861.797763:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000024283836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+13:7450:x1876405527780096:12345-0@lo:256: 20000000:01000000:1.0:1789479861.797776:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789479861.797792:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789479861.797795:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789479861.797865:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000024283836 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+13:7450:x1876405527780096:12345-0@lo:256: Request processed in 103us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.797878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479861.798701:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780096:0@lo:256: 10000000:01000000:3.0:1789479861.799837:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789479861.799911:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.799936:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479861.799943:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a866ce000 from 1 10000000:01000000:3.0:1789479861.799946:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479861.799989:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.799996:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.800032:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479861.800080:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780224:0@lo:101: 00000100:00100000:3.0:1789479861.800155:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.800820:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccb60bf1 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.800911:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780224 00000100:00100000:1.0:1789479861.800929:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780224 00000100:00100000:1.0:1789479861.800976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789479861.800983:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009d4b7a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+13:7450:x1876405527780224:12345-0@lo:101: 00010000:00010000:1.0:1789479861.800995:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479861.801006:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243ced0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.801024:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.801032:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479861.801039:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007deb4c9c, rc 0) 00000100:00100000:1.0:1789479861.801086:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009d4b7a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780224:12345-0@lo:101: Request processed in 104us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.801093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479861.804253:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780224:0@lo:101: 00010000:00010000:3.0:1789479861.804277:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.804823:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479861.804937:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780352:0@lo:501: 00000100:00100000:3.0:1789479861.804989:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.805020:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccb60bf1 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.805101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780352 00000100:00100000:1.0:1789479861.805109:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780352 00000100:00100000:1.0:1789479861.805152:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789479861.805159:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7a6510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780352:12345-0@lo:501: 00000100:00100000:1.0:1789479861.805277:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7a6510 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780352:12345-0@lo:501: Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.805285:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789479861.805590:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780352:0@lo:501: 00000100:00100000:3.0:1789479861.805631:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780480:0@lo:503: 00000100:00100000:3.0:1789479861.805665:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.805692:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccb60bf1 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.805736:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780480 00000100:00100000:1.0:1789479861.805741:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780480 00000100:00100000:1.0:1789479861.805774:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789479861.805780:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000136c019f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780480:12345-0@lo:503: 00000040:00080000:1.0:1789479861.805807:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789479861.805842:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000136c019f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780480:12345-0@lo:503: Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.805848:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789479861.806115:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780480:0@lo:503: 00000040:00080000:3.0:1789479861.806469:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789479861.806525:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1789479861.806596:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789479861.807770:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789479861.807807:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789479861.807826:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479861.816219:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816237:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479861.816300:0:7450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789479861.816303:0:7450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6a866ce000 10000000:01000000:3.0:1789479861.816315:0:7450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6a866ce000 10000000:01000000:3.0:1789479861.816319:0:7450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479861.816331:0:7450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a866ce000 from 1 10000000:01000000:3.0:1789479861.816334:0:7450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479861.816365:0:7450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816373:0:7450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816382:0:7450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479861.816403:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780608:0@lo:101: 00000100:00100000:3.0:1789479861.816462:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.816504:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a49a8b going to sleep for 11 seconds 00000100:00100000:3.0:1789479861.816527:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780608 00000100:00100000:3.0:1789479861.816534:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780608 00000100:00100000:3.0:1789479861.816573:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789479861.816580:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001fb7f7c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+14:7450:x1876405527780608:12345-0@lo:101: 00010000:00010000:3.0:1789479861.816592:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479861.816603:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000fbf6358/0xdaa289fda243cee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cede expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816624:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000fbf6358/0xdaa289fda243cee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cede expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816635:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000fbf6358/0xdaa289fda243cee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cede expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816642:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000fbf6358, rc 0) 00000100:00100000:3.0:1789479861.816675:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001fb7f7c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527780608:12345-0@lo:101: Request processed in 95us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.816687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789479861.816732:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780608:0@lo:101: 00010000:00010000:3.0:1789479861.816744:0:7450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479861.816752:0:7450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479861.816823:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780736:0@lo:501: 00000100:00100000:3.0:1789479861.816846:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.816858:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 0000000050a49a8b going to sleep for 11 seconds 00000100:00100000:3.0:1789479861.816872:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780736 00000100:00100000:3.0:1789479861.816876:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780736 00000100:00100000:3.0:1789479861.816897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789479861.816902:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005dc1a6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527780736:12345-0@lo:501: 00000100:00080000:0.0:1789479861.819732:0:6525:0:(import.c:65:import_set_state_nolock()) 0000000075d29383 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479861.819823:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000415aa430 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527779712:12345-0@lo:38: Request processed in 25366us (25488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479861.819834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479861.820320:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789479861.820329:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789479861.820337:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789479861.820342:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789479861.820344:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000087db4667 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479861.820352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005acf7335 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527779712:0@lo:38: 00000100:00100000:3.0:1789479861.821663:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005dc1a6bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527780736:12345-0@lo:501: Request processed in 4757us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.821674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789479861.823435:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479861.823458:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001449bbd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527780864:0@lo:41: 00000100:00100000:2.0:1789479861.823517:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479861.823653:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780864 00000100:00100000:1.0:1789479861.823662:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780864 00000100:00100000:1.0:1789479861.823711:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479861.823720:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000001394a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527780864:12345-0@lo:41: 00000004:00000024:1.0:1789479861.823752:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789479861.823818:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000001394a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527780864:12345-0@lo:41: Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.823824:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479861.823896:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001449bbd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527780864:0@lo:41: 00000100:00100000:0.0:1789479861.829854:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000774d8db4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780736:0@lo:501: 00000100:00100000:2.0:1789479861.830094:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780992:0@lo:503: 00000100:00100000:2.0:1789479861.830182:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.830261:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000499b7426 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.830338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527780992 00000100:00100000:1.0:1789479861.830346:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527780992 00000100:00100000:1.0:1789479861.830389:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479861.830397:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000645972d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527780992:12345-0@lo:503: 00000100:00100000:1.0:1789479861.830510:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000645972d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527780992:12345-0@lo:503: Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.830518:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789479861.830752:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527780992:0@lo:503: 00000040:00080000:2.0:1789479861.831004:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789479861.831092:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781120:0@lo:502: 00000100:00100000:2.0:1789479861.831129:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.831158:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000499b7426 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.831564:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781120 00000100:00100000:1.0:1789479861.831570:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781120 00000100:00100000:1.0:1789479861.831675:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479861.831681:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fa843d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781120:12345-0@lo:502: 00000100:00100000:1.0:1789479861.831875:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fa843d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781120:12345-0@lo:502: Request processed in 195us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.831896:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789479861.832454:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781120:0@lo:502: 00000040:00080000:2.0:1789479861.832724:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789479861.832777:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789479861.832829:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789479861.832860:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789479861.832878:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789479861.832906:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789479861.833143:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789479861.833159:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789479861.833380:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789479861.833398:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789479861.833411:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789479861.833425:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789479861.833435:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789479861.833448:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789479861.833462:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789479861.833473:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789479861.833487:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789479861.833501:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789479861.833514:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789479861.833527:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789479861.833541:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789479861.833555:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789479861.833567:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789479861.833579:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789479861.833606:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789479861.833621:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789479861.833635:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789479861.833650:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1789479861.833681:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781248:0@lo:502: 00000100:00100000:2.0:1789479861.833735:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.833812:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 00000000499b7426 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.839493:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781248 00000100:00100000:1.0:1789479861.839510:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781248 00000100:00100000:2.0:1789479861.842914:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789479861.842938:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8dba37b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781248:12345-0@lo:502: 00000100:00100000:2.0:1789479861.843455:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8dba37b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781248:12345-0@lo:502: Request processed in 519us (9720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.843464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789479861.843566:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca671557 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781248:0@lo:502: 00000040:00080000:0.0:1789479861.843647:0:7450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789479861.843661:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789479861.844637:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789479861.844651:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000493235fa) 00000020:00000080:0.0:1789479861.844669:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789479861.844755:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e8a4566e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789479861.844759:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e8a4566e from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789479861.844762:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e8a4566e 3 00010000:00080000:0.0:1789479861.844788:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005fab33ce@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789479861.847581:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789479861.847770:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789479861.847810:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789479861.847822:0:7468:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdaa289fda243cef3 00000100:00080000:3.0:1789479861.847831:0:7468:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789479861.847839:0:7468:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000005fab33ce using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789479861.847879:0:7468:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000092db8505 x1876405527781376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789479861.847907:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789479861.848092:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000092db8505 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527781376:0@lo:38: 00000100:00100000:1.0:1789479861.848150:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.852123:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781376 00000100:00100000:3.0:1789479861.852136:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781376 00000100:00100000:3.0:1789479861.854058:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479861.854068:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005acf7335 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527781376:12345-0@lo:38: 00010000:00080000:3.0:1789479861.854099:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:3.0:1789479861.854139:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdaa289fda243cefa 00000004:00100000:3.0:1789479861.854153:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789479861.854211:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000812da17c : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479861.854290:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005acf7335 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876405527781376:12345-0@lo:38: Request processed in 221us (6140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.855024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789479861.855491:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:1.0:1789479861.855908:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:2.0:1789479861.856159:0:7450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789479861.856223:0:7450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479861.856236:0:7450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.856247:0:7450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000003afe7a24/0xdaa289fda243cede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789479861.856293:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789479861.856295:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789479861.856296:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479861.856313:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479861.856314:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479861.856315:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479861.856316:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789479861.856317:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479861.856319:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479861.856320:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479861.856322:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789479861.856324:0:7450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789479861.856332:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789479861.856333:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789479861.856334:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479861.856335:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479861.856336:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479861.856336:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479861.856337:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789479861.856338:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479861.856339:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479861.856340:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479861.856340:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789479861.856363:0:7450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789479861.856378:0:7450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a2a83f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781504:0@lo:253: 00000100:00100000:2.0:1789479861.856431:0:7450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.856463:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781504 00000100:00100000:2.0:1789479861.856468:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781504 00000100:00100000:2.0:1789479861.856500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789479861.856507:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f51d2445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781504:12345-0@lo:253: 20000000:01000000:2.0:1789479861.856529:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789479861.856540:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789479861.856867:0:7450:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f1fdbd4 going to sleep for 11 seconds 00010000:00080000:0.0:1789479861.858604:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000092db8505 x1876405527781376/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479861.858626:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789479861.858634:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789479861.858642:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789479861.858647:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789479861.858650:0:3644:0:(import.c:65:import_set_state_nolock()) 000000005fab33ce lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789479861.858656:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000092db8505 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527781376:0@lo:38: 00000001:00100000:2.0:1789479861.862376:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789479861.862444:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789479861.862458:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789479861.862715:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f51d2445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7450:x1876405527781504:12345-0@lo:253: Request processed in 6206us (6281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.862727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789479861.862811:0:7450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a2a83f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:7450:1876405527781504:0@lo:253: 10000000:01000000:0.0:1789479861.862824:0:7450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789479861.862827:0:7450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479861.862828:0:7450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789479861.862830:0:7450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479861.862831:0:7450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479861.862832:0:7450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479861.862833:0:7450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479861.862834:0:7450:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789479861.862835:0:7450:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479861.862837:0:7450:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479861.862838:0:7450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479861.862839:0:7450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479861.862851:0:7450:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789479861.866478:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789479861.866487:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789479861.866510:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866526:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866532:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866537:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866585:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866598:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.866610:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad6a78a6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527781632:0@lo:104: 00000100:00100000:2.0:1789479861.866662:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479861.866720:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866727:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.866734:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527781760:0@lo:104: 00000100:00100000:2.0:1789479861.866753:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.866770:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8c84901 going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.866792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781632 00000100:00100000:2.0:1789479861.866799:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781632 00000100:00100000:2.0:1789479861.866829:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781760 00000100:00100000:2.0:1789479861.866831:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781760 00000100:00100000:2.0:1789479861.866843:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479861.866850:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007fbbed50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6536:x1876405527781632:12345-0@lo:104: 00010000:00010000:2.0:1789479861.866861:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866905:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479861.866909:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007fbbed50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6536:x1876405527781632:12345-0@lo:104: Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.866936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479861.866953:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479861.866957:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000145f1645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527781760:12345-0@lo:104: 00010000:00010000:2.0:1789479861.866963:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.866995:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789479861.866998:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000145f1645 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527781760:12345-0@lo:104: Request processed in 42us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.867003:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789479861.867017:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789479861.867022:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867028:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076e08459 already unused, calling callback (00000000680b9bb4) 10000000:00010000:2.0:1789479861.867031:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867037:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479861.867043:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479861.867048:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479861.867086:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867092:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479861.867113:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867118:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 0000000076e08459/0xdaa289fda243cec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cec9 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867130:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789479861.867132:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867137:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b58d5314 already unused, calling callback (00000000680b9bb4) 10000000:00010000:2.0:1789479861.867138:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867144:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479861.867148:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479861.867153:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479861.867429:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867435:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479861.867441:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867447:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000b58d5314/0xdaa289fda243ce1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce21 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479861.867466:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479861.867468:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479861.867474:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479861.867487:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bc91fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527781888:0@lo:103: 00000100:00100000:2.0:1789479861.867517:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.867551:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479861.867557:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000557c9fdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527782016:0@lo:103: 00000100:00100000:2.0:1789479861.867581:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.867615:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527781888 00000100:00100000:2.0:1789479861.867620:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527781888 00010000:00010000:2.0:1789479861.867636:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 15 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.867655:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782016 00000100:00100000:2.0:1789479861.867657:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782016 00010000:00010000:2.0:1789479861.867666:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 16 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.867678:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479861.867683:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a2a83f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+16:3647:x1876405527781888:12345-0@lo:103: 00010000:00010000:2.0:1789479861.867692:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479861.867695:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 16 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867705:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 16 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867719:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479861.867744:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a2a83f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+16:3647:x1876405527781888:12345-0@lo:103: Request processed in 62us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.867760:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479861.867773:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479861.867778:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b087b49c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+15:3647:x1876405527782016:12345-0@lo:103: 00010000:00010000:2.0:1789479861.867786:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479861.867789:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 15 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867798:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 15 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867809:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867816:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789479861.867828:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002625747s 00010000:00010000:2.0:1789479861.867831:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867838:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867844:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867849:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867855:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000631d0828 already unused, calling callback (000000007e7d2c58) 00010000:00010000:2.0:1789479861.867863:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867870:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867878:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.867887:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479861.867908:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b087b49c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+15:3647:x1876405527782016:12345-0@lo:103: Request processed in 131us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.867914:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479861.868260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000557c9fdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527782016:0@lo:103: 00000100:00100000:2.0:1789479861.868269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bc91fbb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527781888:0@lo:103: 00010000:00010000:2.0:1789479861.868293:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cec2 expref: 14 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.868302:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad6a78a6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527781632:0@lo:104: 00010000:00010000:2.0:1789479861.868323:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001608db33/0xdaa289fda243ce21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243ce1a expref: 13 pid: 6512 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479861.868332:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527781760:0@lo:104: 00010000:00010000:2.0:1789479861.868344:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.868351:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.868367:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479861.868373:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000631d0828/0xdaa289fda243cf01 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789479861.871029:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.871256:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789479861.871498:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.871730:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789479861.871929:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.872094:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789479861.881285:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.881536:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789479861.881733:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.881906:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789479861.882072:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1789479861.882283:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789479861.889757:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789479861.890059:0:7473:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789479861.890074:0:7473:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789479861.891575:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789479861.891628:0:7474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000043af2549 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876405527782144:0@lo:700: 00000100:00100000:3.0:1789479861.891701:0:7474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479861.891738:0:7474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1751db4 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.891793:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782144 00000100:00100000:1.0:1789479861.891801:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782144 00000100:00100000:1.0:1789479861.891847:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479861.891855:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008db46b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876405527782144:12345-0@lo:700: 00000040:01000000:0.0:1789479861.892086:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789479861.892577:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782272:0@lo:1000: 00000100:00100000:0.0:1789479861.892617:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.892643:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aeb5e010 going to sleep for 11 seconds 00000100:00100000:1.0:1789479861.892686:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782272 00000100:00100000:1.0:1789479861.892691:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782272 00000100:00100000:1.0:1789479861.892726:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479861.892733:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d5c69c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782272:12345-0@lo:1000: 00000100:00100000:1.0:1789479861.892798:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d5c69c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782272:12345-0@lo:1000: Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.892806:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:1.0:1789479861.893437:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789479861.893550:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789479861.894904:0:7450:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789479861.895129:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789479861.895497:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479861.903366:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782272:0@lo:1000: 00000040:01000000:0.0:1789479861.903412:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789479861.903469:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782400:0@lo:700: 00000100:00100000:0.0:1789479861.903524:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.903568:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cda5a6c going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.903657:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782400 00000100:00100000:2.0:1789479861.903665:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782400 00000100:00100000:2.0:1789479861.903708:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479861.903716:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd14e75c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782400:12345-0@lo:700: 00000100:00100000:2.0:1789479861.903772:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd14e75c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782400:12345-0@lo:700: Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.903779:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789479861.903811:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782400:0@lo:700: 00000100:00100000:2.0:1789479861.903856:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876405527782528:0@lo:900: 00000100:00100000:2.0:1789479861.903884:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.903904:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a8c84901 going to sleep for 11 seconds 00000040:00080000:1.0:1789479861.904740:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789479861.904819:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782528 00000100:00100000:1.0:1789479861.904823:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782528 00000100:00100000:1.0:1789479861.904893:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479861.904900:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6a78a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876405527782528:12345-0@lo:900: 00000100:00100000:1.0:1789479861.904956:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6a78a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7475:x1876405527782528:12345-0@lo:900: Request processed in 57us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479861.904963:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789479861.905030:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004d17aa6a x1876405527782528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789479877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479861.905040:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7475:1876405527782528:0@lo:900: 00000100:00100000:2.0:1789479861.905132:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782656:0@lo:1000: 00000100:00100000:2.0:1789479861.905161:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.905224:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782656 00000100:00100000:2.0:1789479861.905229:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782656 00000100:00100000:2.0:1789479861.905254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479861.905259:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004bc91fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782656:12345-0@lo:1000: 00000100:00100000:2.0:1789479861.905337:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004bc91fbb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782656:12345-0@lo:1000: Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.905343:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479861.905424:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c7ee854 going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.905437:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782656:0@lo:1000: 00000004:00080000:2.0:1789479861.905485:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a8c84901 with version 0 00000020:00100000:2.0:1789479861.905498:0:7475:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789479861.905503:0:7475:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004d17aa6a x1876405527782912/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789479861.905513:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782912:0@lo:1000: 00000100:00100000:2.0:1789479861.905535:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.905554:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527782912 00000100:00100000:2.0:1789479861.905557:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527782912 00000100:00100000:2.0:1789479861.905577:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479861.905581:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000557c9fdb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782912:12345-0@lo:1000: 00000100:00100000:2.0:1789479861.905870:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f62cbaad going to sleep for 11 seconds 00000040:00080000:0.0:1789479861.915887:0:7450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789479861.915957:0:7450:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1789479861.916470:0:7450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789479861.916709:0:7450:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000001:00080000:2.0:1789479861.918273:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:2.0:1789479861.918397:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000557c9fdb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527782912:12345-0@lo:1000: Request processed in 12812us (12858us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789479861.918409:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1789479861.918468:0:7475:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1789479861.918473:0:7475:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789479861.918486:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527782912:0@lo:1000: 00000100:00100000:2.0:1789479861.918560:0:7475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527783040:0@lo:1000: 00000100:00100000:2.0:1789479861.918593:0:7475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479861.918627:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783040 00000100:00100000:2.0:1789479861.918634:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783040 00000100:00100000:2.0:1789479861.918665:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479861.918672:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001581e403 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527783040:12345-0@lo:1000: 00000100:00100000:2.0:1789479861.918724:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001581e403 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7475:x1876405527783040:12345-0@lo:1000: Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479861.918730:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789479861.918756:0:7475:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc0f7b86 going to sleep for 11 seconds 00000100:00100000:2.0:1789479861.918768:0:7475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d17aa6a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7475:1876405527783040:0@lo:1000: 00000040:00080000:2.0:1789479861.918782:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1789479861.918804:0:7475:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000a8c84901 with version 1 40000000:02000000:3.0:1789479861.919101:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000004:00080000:0.0:1789479861.921436:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000049709894 version 1 rpc_version 1 00000020:00100000:0.0:1789479861.922106:0:7465:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789479861.922116:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e3c0105f x1876405527783296/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789479861.922138:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1876405527783296:0@lo:1000: 00100000:10000000:1.0:1789479861.922695:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:0.0:1789479861.923282:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479861.923339:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cda5a6c going to sleep for 11 seconds 00100000:10000000:1.0:1789479861.924279:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000100:00100000:0.0:1789479861.924564:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783296 00000100:00100000:0.0:1789479861.924573:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783296 00000100:00100000:0.0:1789479861.924615:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479861.924628:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001449bbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1876405527783296:12345-0@lo:1000: 00100000:10000000:1.0:1789479861.927146:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789479861.931448:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789479861.931650:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789479861.931867:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789479861.931998:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789479861.932133:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789479861.932345:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789479861.932485:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789479861.932631:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789479861.932760:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789479861.932916:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:3.0:1789479861.941453:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008db46b24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7474:x1876405527782144:12345-0@lo:700: Request processed in 49592us (49745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479861.941472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789479861.941789:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000043af2549 x1876405527782144/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789479877 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479861.941804:0:7474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000043af2549 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876405527782144:0@lo:700: 40000000:02000000:0.0:1789479861.941816:0:7474:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000040:00080000:2.0:1789479861.945358:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789479861.945434:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1789479861.945870:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789479861.946408:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789479861.947657:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789479861.950399:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000001:00080000:2.0:1789479861.952980:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789479861.953273:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001449bbd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1876405527783296:12345-0@lo:1000: Request processed in 28643us (29989us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789479861.953301:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1789479861.953367:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789479861.953372:0:7465:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789479861.953387:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e3c0105f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1876405527783296:0@lo:1000: 00100000:10000000:1.0:1789479861.953898:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789479861.956748:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789479861.956964:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789479861.961381:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789479861.978277:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789479861.978562:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789479861.978723:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789479861.979186:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789479861.979426:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789479861.979586:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789479861.979739:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789479861.979857:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789479861.980113:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789479861.980487:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789479861.980665:0:7450:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789479861.980853:0:7450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789479862.011461:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1789479862.013538:0:7450:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789479862.013572:0:7450:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9c0c01cc3988 00100000:10000000:1.0:1789479862.013579:0:7450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1789479862.015329:0:7450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789479862.015358:0:7450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789479862.015379:0:7450:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789479862.015395:0:7450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1789479862.016277:0:7450:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479862.017767:0:7450:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789479862.019424:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789479862.019493:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789479862.019498:0:7474:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789479862.533285:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479863.556338:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479864.580455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479865.604281:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479866.628406:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789479866.780850:0:7720:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789479867.078144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c632b8c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527783680:0@lo:400: 00000100:00100000:3.0:1789479867.078241:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479867.078310:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479867.078317:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527783808:0@lo:400: 00000100:00100000:3.0:1789479867.078343:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479867.078384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783808 00000100:00100000:3.0:1789479867.078391:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783808 00000100:00100000:3.0:1789479867.078432:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479867.078439:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001025f8db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527783808:12345-0@lo:400: 00000100:00100000:3.0:1789479867.078489:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001025f8db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527783808:12345-0@lo:400: Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479867.078496:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789479867.078535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ae80dfa1 x1876405527783808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479867.078548:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527783808:0@lo:400: 00000100:00100000:0.0:1789479867.079591:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783680 00000100:00100000:0.0:1789479867.079601:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783680 00000100:00100000:0.0:1789479867.079636:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789479867.079644:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001dfaa6b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527783680:12345-0@lo:400: 00000100:00100000:2.0:1789479867.079724:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4866aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527783424:0@lo:400: 00000100:00100000:0.0:1789479867.079726:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001dfaa6b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527783680:12345-0@lo:400: Request processed in 82us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479867.079737:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789479867.079774:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c632b8c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527783680:0@lo:400: 00000100:00100000:2.0:1789479867.079779:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479867.079811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000995535b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527783936:0@lo:41: 00000100:00100000:2.0:1789479867.079831:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479867.079849:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479867.079854:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a54aca83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527783552:0@lo:400: 00000100:00100000:2.0:1789479867.079874:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479867.079881:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783936 00000100:00100000:0.0:1789479867.079886:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783936 00000100:00100000:0.0:1789479867.079907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479867.079912:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d17aa6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527783936:12345-0@lo:41: 00000004:00000024:0.0:1789479867.080136:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789479867.080184:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d17aa6a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527783936:12345-0@lo:41: Request processed in 271us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479867.080234:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479867.080338:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000995535b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527783936:0@lo:41: 00000100:00100000:1.0:1789479867.081357:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783552 00000100:00100000:1.0:1789479867.081367:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783552 00000100:00100000:1.0:1789479867.081424:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789479867.081431:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bd7e3fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527783552:12345-0@lo:400: 00000100:00100000:1.0:1789479867.081509:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bd7e3fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527783552:12345-0@lo:400: Request processed in 78us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479867.081516:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479867.081859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527783424 00000100:00100000:3.0:1789479867.081864:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527783424 00010000:00080000:0.0:1789479867.083979:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a54aca83 x1876405527783552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479867.083998:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a54aca83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527783552:0@lo:400: 00000100:00100000:3.0:1789479867.084315:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479867.084331:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe6a2714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+13:3645:x1876405527783424:12345-0@lo:400: 00000100:00100000:3.0:1789479867.084405:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe6a2714 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+13:3645:x1876405527783424:12345-0@lo:400: Request processed in 81us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479867.084425:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789479867.084806:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4866aa0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527783424:0@lo:400: 00000020:00000004:0.0:1789479867.425287:0:7772:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789479867.425569:0:7772:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789479867.653374:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479868.676365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789479869.127182:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789479869.127232:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a866ce000 from 4 10000000:01000000:1.0:1789479869.127236:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479869.127284:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.127294:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.127303:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.127445:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784064:0@lo:101: 00000100:00100000:1.0:1789479869.127506:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.127582:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1f316c going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.129484:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784064 00000100:00100000:0.0:1789479869.129496:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784064 00000100:00100000:0.0:1789479869.129564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789479869.129572:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003c9aa519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+13:6517:x1876405527784064:12345-0@lo:101: 00010000:00010000:0.0:1789479869.129586:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479869.129601:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000076e08459/0xdaa289fda243cf0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf08 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.129623:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076e08459/0xdaa289fda243cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.129632:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000076e08459/0xdaa289fda243cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.129639:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000076e08459, rc 0) 00000100:00100000:0.0:1789479869.129694:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003c9aa519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+14:6517:x1876405527784064:12345-0@lo:101: Request processed in 123us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.129700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789479869.132815:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784064:0@lo:101: 00010000:00010000:1.0:1789479869.132840:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.132853:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.132914:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784192:0@lo:256: 00000100:00100000:1.0:1789479869.132966:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.133009:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1f316c going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.133128:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784192 00000100:00100000:3.0:1789479869.133146:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784192 00000100:00100000:3.0:1789479869.133351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789479869.133359:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c4ac2b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:6517:x1876405527784192:12345-0@lo:256: 20000000:01000000:3.0:1789479869.133379:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789479869.133393:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789479869.133396:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789479869.133474:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c4ac2b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:6517:x1876405527784192:12345-0@lo:256: Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.133481:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789479869.134042:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784192:0@lo:256: 10000000:01000000:1.0:1789479869.134081:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789479869.134087:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.134104:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 0000000091cc5a9e/0xdaa289fda243cf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479869.134111:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789479869.134114:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a83cfb000 from 21 10000000:01000000:1.0:1789479869.134116:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789479869.134147:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.134153:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.134160:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.134172:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784320:0@lo:101: 00000100:00100000:1.0:1789479869.134220:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.134244:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1f316c going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.135711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784320 00000100:00100000:3.0:1789479869.135723:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784320 00000100:00100000:3.0:1789479869.135779:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789479869.135787:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ed44b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+14:6517:x1876405527784320:12345-0@lo:101: 00010000:00010000:3.0:1789479869.135802:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479869.135816:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086914a80/0xdaa289fda243cf1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf16 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.135838:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086914a80/0xdaa289fda243cf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.135847:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086914a80/0xdaa289fda243cf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.135855:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086914a80, rc 0) 00000100:00100000:3.0:1789479869.135912:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ed44b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784320:12345-0@lo:101: Request processed in 126us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.135932:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789479869.136093:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784320:0@lo:101: 00010000:00010000:1.0:1789479869.136108:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.136115:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.136214:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784448:0@lo:501: 00000100:00100000:1.0:1789479869.136247:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.136289:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1f316c going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.136360:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784448 00000100:00100000:0.0:1789479869.136371:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784448 00000100:00100000:0.0:1789479869.136399:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789479869.136404:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008573591a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784448:12345-0@lo:501: 00000100:00100000:0.0:1789479869.136515:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008573591a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784448:12345-0@lo:501: Request processed in 111us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.136521:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789479869.136705:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784448:0@lo:501: 00000100:00100000:1.0:1789479869.136731:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784576:0@lo:503: 00000100:00100000:1.0:1789479869.136767:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.136789:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d1f316c going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.136833:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784576 00000100:00100000:0.0:1789479869.136838:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784576 00000100:00100000:0.0:1789479869.136869:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789479869.136874:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000025ed3ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784576:12345-0@lo:503: 00000100:00100000:0.0:1789479869.136942:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000025ed3ff5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784576:12345-0@lo:503: Request processed in 67us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.136949:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789479869.139626:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784576:0@lo:503: 00000100:00100000:1.0:1789479869.141817:0:7829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7829:1876405527784704:0@lo:502: 00000100:00100000:1.0:1789479869.141898:0:7829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.141942:0:7829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7f50933 going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.142918:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784704 00000100:00100000:0.0:1789479869.142927:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784704 00000100:00100000:0.0:1789479869.142996:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789479869.143005:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002d05e7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:7829:x1876405527784704:12345-0@lo:502: 00000100:00100000:0.0:1789479869.143957:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002d05e7d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:7829:x1876405527784704:12345-0@lo:502: Request processed in 950us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.143968:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789479869.145900:0:7829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7829:1876405527784704:0@lo:502: 00000100:00100000:1.0:1789479869.146133:0:7829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7829:1876405527784832:0@lo:502: 00000100:00100000:1.0:1789479869.146255:0:7829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.146345:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784832 00000100:00100000:0.0:1789479869.146353:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784832 00000100:00100000:0.0:1789479869.146401:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789479869.146410:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fe53ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7829:x1876405527784832:12345-0@lo:502: 00000100:00100000:1.0:1789479869.146443:0:7829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7f50933 going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.146548:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fe53ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:7829:x1876405527784832:12345-0@lo:502: Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.146556:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479869.146578:0:7829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7829:1876405527784832:0@lo:502: 00000040:00080000:1.0:1789479869.146602:0:7829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789479869.146871:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789479869.146893:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479869.146901:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.146911:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000009ac1d6ed/0xdaa289fda243cf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479869.146920:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789479869.146922:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a83cfb000 from 4 10000000:01000000:0.0:1789479869.146925:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789479869.146947:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.146954:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.146961:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479869.146974:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784960:0@lo:101: 00000100:00100000:0.0:1789479869.147007:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.147334:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fe81315 going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.152405:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527784960 00000100:00100000:3.0:1789479869.152420:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527784960 00000100:00100000:3.0:1789479869.152482:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789479869.152501:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004130c751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527784960:12345-0@lo:101: 00010000:00010000:3.0:1789479869.152519:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479869.152536:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cf2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf24 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.152560:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cf2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.152569:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4da8e39/0xdaa289fda243cf2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.152577:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4da8e39, rc 0) 00000100:00100000:3.0:1789479869.152649:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004130c751 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527784960:12345-0@lo:101: Request processed in 159us (5643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.152655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789479869.152737:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527784960:0@lo:101: 00010000:00010000:0.0:1789479869.152754:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.152766:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479869.152839:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785088:0@lo:256: 00000100:00100000:0.0:1789479869.152871:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.152896:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fe81315 going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.153179:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785088 00000100:00100000:3.0:1789479869.153184:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785088 00000100:00100000:3.0:1789479869.153234:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789479869.153240:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b9e4890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527785088:12345-0@lo:256: 20000000:01000000:3.0:1789479869.153253:0:6515:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789479869.153281:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789479869.153284:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789479869.153363:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b9e4890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527785088:12345-0@lo:256: Request processed in 124us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.153378:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789479869.153400:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8ab4f09 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785088:0@lo:256: 10000000:01000000:1.0:1789479869.153443:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789479869.153449:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.153456:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000008a636942/0xdaa289fda243cf24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479869.153464:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789479869.153466:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789479869.153473:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789479869.153492:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.153499:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.153506:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.153516:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785216:0@lo:101: 00000100:00100000:1.0:1789479869.153542:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.153561:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7f50933 going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.154391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785216 00000100:00100000:3.0:1789479869.154398:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785216 00000100:00100000:3.0:1789479869.154438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789479869.154445:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf8adee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527785216:12345-0@lo:101: 00010000:00010000:3.0:1789479869.154455:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479869.154467:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c94b2c50/0xdaa289fda243cf39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf32 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.154485:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c94b2c50/0xdaa289fda243cf39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.155413:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c94b2c50/0xdaa289fda243cf39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479869.155423:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c94b2c50, rc 0) 00000100:00100000:3.0:1789479869.155488:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf8adee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527785216:12345-0@lo:101: Request processed in 1043us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.155495:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789479869.157728:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785216:0@lo:101: 00010000:00010000:1.0:1789479869.157754:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479869.157764:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479869.157838:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785344:0@lo:501: 00000100:00100000:1.0:1789479869.157886:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.157927:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7f50933 going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.158058:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785344 00000100:00100000:0.0:1789479869.158064:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785344 00000100:00100000:0.0:1789479869.158106:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789479869.158114:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073596d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527785344:12345-0@lo:501: 00000100:00100000:0.0:1789479869.158279:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073596d66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527785344:12345-0@lo:501: Request processed in 165us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.158285:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479869.159463:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000017bcf6b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785344:0@lo:501: 00000100:00100000:3.0:1789479869.159513:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785472:0@lo:503: 00000100:00100000:3.0:1789479869.159568:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.159606:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000521eb1f2 going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.159726:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785472 00000100:00100000:0.0:1789479869.159733:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785472 00000100:00100000:0.0:1789479869.159773:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789479869.159780:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001c7c1033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527785472:12345-0@lo:503: 00000100:00100000:0.0:1789479869.159878:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001c7c1033 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527785472:12345-0@lo:503: Request processed in 99us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.159885:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789479869.160338:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527785472:0@lo:503: 00000100:00100000:1.0:1789479869.162033:0:7831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c95edd5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7831:1876405527785600:0@lo:502: 00000100:00100000:1.0:1789479869.162099:0:7831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.162141:0:7831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000393e553a going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.162216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785600 00000100:00100000:0.0:1789479869.162224:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785600 00000100:00100000:0.0:1789479869.163655:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479869.163668:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f6e8f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:7831:x1876405527785600:12345-0@lo:502: 00000100:00100000:0.0:1789479869.163808:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f6e8f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:7831:x1876405527785600:12345-0@lo:502: Request processed in 144us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.163815:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789479869.163893:0:7831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c95edd5d pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7831:1876405527785600:0@lo:502: 00000020:01000000:1.0:1789479869.163927:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479869.163936:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479869.163938:0:7831:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1789479869.163942:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789479869.163946:0:7831:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:1.0:1789479869.163967:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789479869.163979:0:7831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000005862bfa7) 00000020:00000080:1.0:1789479869.163996:0:7831:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1789479869.164001:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789479869.164091:0:7831:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1789479869.164109:0:7831:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789479869.164116:0:7831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243cf47 00010000:00080000:1.0:1789479869.164140:0:7831:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bf662fca@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1789479869.169100:0:7831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789479869.170319:0:7831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789479869.170333:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789479869.170363:0:7831:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789479869.170392:0:7831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243cf4e 00000100:00080000:1.0:1789479869.170402:0:7831:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479869.170412:0:7831:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000bf662fca using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789479869.170444:0:7831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c95edd5d x1876405527785728/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479869.170466:0:7831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789479869.170508:0:7831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789479869.170599:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c95edd5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527785728:0@lo:38: 00000100:00100000:2.0:1789479869.170674:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.170824:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785728 00000100:00100000:1.0:1789479869.170831:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785728 00000100:00100000:1.0:1789479869.170866:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479869.170872:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008a2a83f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527785728:12345-0@lo:38: 00010000:00080000:1.0:1789479869.170892:0:6526:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1789479869.170927:0:6526:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243cf55 00000004:00100000:1.0:1789479869.170940:0:6526:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789479869.170944:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789479869.171102:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479869.171112:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb1de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527785856:0@lo:400: 00000100:00100000:3.0:1789479869.171142:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.171169:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527785984:0@lo:400: 00000100:00100000:3.0:1789479869.171220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.171234:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479869.171238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527786112:0@lo:400: 00000100:00100000:3.0:1789479869.171258:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.171322:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785856 00000100:00100000:3.0:1789479869.171326:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785856 00000100:00100000:3.0:1789479869.171353:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786112 00000100:00100000:3.0:1789479869.171356:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786112 00000100:00100000:3.0:1789479869.171368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479869.171372:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b4866aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527785856:12345-0@lo:400: 00000100:00100000:3.0:1789479869.171412:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b4866aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527785856:12345-0@lo:400: Request processed in 40us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.171419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479869.171432:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789479869.171437:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c632b8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527786112:12345-0@lo:400: 00000100:00100000:3.0:1789479869.171464:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c632b8c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527786112:12345-0@lo:400: Request processed in 28us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.171469:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789479869.171503:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000eb1de5ee x1876405527785856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479869.171515:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb1de5ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527785856:0@lo:400: 00010000:00080000:3.0:1789479869.171538:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ae80dfa1 x1876405527786112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479869.171546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ae80dfa1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527786112:0@lo:400: 00000100:00100000:2.0:1789479869.171947:0:6525:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789479869.171956:0:6525:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789479869.172033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527785984 00000100:00100000:2.0:1789479869.172038:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527785984 00000100:00100000:2.0:1789479869.172126:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479869.172133:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a54aca83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527785984:12345-0@lo:400: 00000100:00100000:2.0:1789479869.172183:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a54aca83 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527785984:12345-0@lo:400: Request processed in 52us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479869.172204:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789479869.172297:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527785984:0@lo:400: 00000020:01000000:1.0:1789479869.175290:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479869.175298:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479869.175300:0:7831:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789479869.175304:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479869.175307:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479869.175308:0:7831:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479869.175311:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479869.175313:0:7831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789479869.175333:0:7831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7831:1876405527786368:0@lo:502: 00000100:00100000:1.0:1789479869.175393:0:7831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479869.175429:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786368 00000100:00100000:1.0:1789479869.175434:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786368 00000100:00100000:1.0:1789479869.175471:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789479869.175551:0:7835:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000802f2947 x1876405527786240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479869.175568:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c63654 going to sleep for 0 seconds 00000100:00100000:1.0:1789479869.175876:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000086d9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:7831:x1876405527786368:12345-0@lo:502: 00000100:00100000:1.0:1789479869.176234:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000086d9e52b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:7831:x1876405527786368:12345-0@lo:502: Request processed in 362us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479869.176242:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789479869.176298:0:7831:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f198ca2 going to sleep for 11 seconds 00000100:00100000:1.0:1789479869.176316:0:7831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:7831:1876405527786368:0@lo:502: 00000020:01000000:1.0:1789479869.176341:0:7831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479869.176349:0:7831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479869.176350:0:7831:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479869.176354:0:7831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789479869.176462:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789479869.176486:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789479869.176492:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176501:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000003dbfd1b4/0xdaa289fda243cf32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479869.176510:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789479869.176513:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a6a95c999c0 from 1 10000000:01000000:0.0:1789479869.176515:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789479869.176537:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176543:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176550:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479869.176562:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527786496:0@lo:101: 00000100:00100000:0.0:1789479869.176590:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.176609:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd10cc2e going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.176622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786496 00000100:00100000:0.0:1789479869.176627:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786496 00000100:00100000:0.0:1789479869.176666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479869.176672:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008867a046 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527786496:12345-0@lo:101: 00010000:00010000:0.0:1789479869.176680:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479869.176690:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028ca9067/0xdaa289fda243cf63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf5c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176719:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028ca9067/0xdaa289fda243cf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176727:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028ca9067/0xdaa289fda243cf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176733:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028ca9067, rc 0) 00000100:00100000:0.0:1789479869.176761:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008867a046 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527786496:12345-0@lo:101: Request processed in 89us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.176766:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479869.176793:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527786496:0@lo:101: 00010000:00010000:0.0:1789479869.176803:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.176810:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479869.176859:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527786624:0@lo:501: 00000100:00100000:0.0:1789479869.176882:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.176894:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd10cc2e going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.177486:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786624 00000100:00100000:0.0:1789479869.177491:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786624 00000100:00100000:0.0:1789479869.177516:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789479869.177521:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e6804a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527786624:12345-0@lo:501: 00000100:00100000:0.0:1789479869.177584:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e6804a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527786624:12345-0@lo:501: Request processed in 62us (701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479869.177591:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789479869.177644:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527786624:0@lo:501: 10000000:01000000:0.0:1789479869.177669:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789479869.177675:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479869.177682:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: 000000002f1d5bf6/0xdaa289fda243cf5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789479869.186986:0:6526:0:(import.c:65:import_set_state_nolock()) 000000004af5975e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479869.187088:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008a2a83f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527785728:12345-0@lo:38: Request processed in 16213us (16413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479869.187106:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479869.187888:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479869.187898:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789479869.187906:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789479869.187911:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789479869.187913:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000bf662fca lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789479869.187938:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000035c63654): req@00000000802f2947 x1876405527786240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479869.187955:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c95edd5d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527785728:0@lo:38: 00000100:00100000:3.0:1789479869.188031:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479869.188056:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527786752:0@lo:41: 00000100:00100000:3.0:1789479869.188061:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c63654 going to sleep for 11 seconds 00000100:00100000:2.0:1789479869.188089:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.188156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786240 00000100:00100000:0.0:1789479869.188163:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786240 00000100:00100000:0.0:1789479869.188216:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786752 00000100:00100000:0.0:1789479869.188219:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786752 00000100:00100000:0.0:1789479869.188233:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789479869.188238:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae80dfa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7835:x1876405527786240:12345-0@lo:1000: 00000100:00100000:3.0:1789479869.188312:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479869.188320:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae80dfa1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7835:x1876405527786240:12345-0@lo:1000: Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.188326:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ca671557 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1876405527786752:12345-0@lo:41: 00000100:00100000:0.0:1789479869.188332:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00000024:3.0:1789479869.188351:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789479869.188401:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ca671557 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527786752:12345-0@lo:41: Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.188408:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479869.188442:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527786240:0@lo:1000: 00000100:00100000:0.0:1789479869.188449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527786752:0@lo:41: 00000040:01000000:3.0:1789479869.188477:0:7835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789479869.188507:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527786880:0@lo:1000: 00000100:00100000:3.0:1789479869.188535:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.188553:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c63654 going to sleep for 11 seconds 00000100:00100000:0.0:1789479869.188555:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527786880 00000100:00100000:0.0:1789479869.188559:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527786880 00000100:00100000:0.0:1789479869.188588:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789479869.188594:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb1de5ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527786880:12345-0@lo:1000: 00000100:00100000:0.0:1789479869.188685:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb1de5ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527786880:12345-0@lo:1000: Request processed in 92us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479869.188691:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479869.188734:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527786880:0@lo:1000: 00000100:00100000:3.0:1789479869.188771:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787008:0@lo:700: 00000100:00100000:3.0:1789479869.188805:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.188828:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006dd5a8c going to sleep for 11 seconds 00000100:00100000:2.0:1789479869.189114:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787008 00000100:00100000:2.0:1789479869.189119:0:6530:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787008 00000100:00100000:2.0:1789479869.189144:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479869.189150:0:6530:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000043af2549 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527787008:12345-0@lo:700: 00000100:00100000:2.0:1789479869.189220:0:6530:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000043af2549 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527787008:12345-0@lo:700: Request processed in 69us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479869.189227:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479869.189247:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787008:0@lo:700: 00000100:00100000:0.0:1789479869.189392:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787136:0@lo:1000: 00000100:00100000:0.0:1789479869.189425:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.189447:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fe81315 going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.190974:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787136 00000100:00100000:3.0:1789479869.190986:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787136 00000100:00100000:3.0:1789479869.191032:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479869.191041:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ea3b4dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527787136:12345-0@lo:1000: 00000100:00100000:3.0:1789479869.191140:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ea3b4dbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527787136:12345-0@lo:1000: Request processed in 101us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479869.191147:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479869.191218:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e800641c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787136:0@lo:1000: 00000004:00080000:3.0:1789479869.191300:0:7835:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000dd10cc2e with version 0 00000020:00100000:3.0:1789479869.191319:0:7835:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789479869.191326:0:7835:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c99c4a35 x1876405527787392/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789479869.191342:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c99c4a35 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787392:0@lo:1000: 00000100:00100000:3.0:1789479869.191378:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479869.191405:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787392 00000100:00100000:3.0:1789479869.191409:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787392 00000100:00100000:3.0:1789479869.191434:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789479869.191441:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000092db8505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7835:x1876405527787392:12345-0@lo:1000: 00000100:00100000:3.0:1789479869.191747:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035c63654 going to sleep for 11 seconds 00000001:00080000:1.0:1789479869.204762:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:1.0:1789479869.204775:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789479869.204976:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000092db8505 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7835:x1876405527787392:12345-0@lo:1000: Request processed in 13533us (13595us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789479869.204988:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789479869.205129:0:7835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789479869.205133:0:7835:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789479869.205147:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c99c4a35 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787392:0@lo:1000: 00000100:00100000:1.0:1789479869.205254:0:7835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787520:0@lo:1000: 00000100:00100000:1.0:1789479869.205308:0:7835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479869.205351:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787520 00000100:00100000:1.0:1789479869.205352:0:7835:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f198ca2 going to sleep for 11 seconds 00000100:00100000:2.0:1789479869.205359:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787520 00000100:00100000:2.0:1789479869.205401:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789479869.205409:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087e2ab77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7835:x1876405527787520:12345-0@lo:1000: 00000100:00100000:2.0:1789479869.205485:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087e2ab77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7835:x1876405527787520:12345-0@lo:1000: Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479869.205501:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789479869.205593:0:7835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7835:1876405527787520:0@lo:1000: 00000040:00080000:1.0:1789479869.205612:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789479869.205638:0:7835:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001d1f316c with version 1 00000004:00080000:0.0:1789479869.206942:0:7833:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004c9692bf version 1 rpc_version 1 00000020:00100000:0.0:1789479869.206971:0:7833:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789479869.206979:0:7833:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000068beab53 x1876405527787776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789479869.206997:0:7833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1876405527787776:0@lo:1000: 00000100:00100000:0.0:1789479869.207046:0:7833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479869.207066:0:7833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aec1bc21 going to sleep for 11 seconds 00000100:00100000:3.0:1789479869.207175:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787776 00000100:00100000:3.0:1789479869.207182:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787776 00000100:00100000:3.0:1789479869.207247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789479869.207266:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7422f68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7833:x1876405527787776:12345-0@lo:1000: 00000040:00080000:1.0:1789479869.208558:0:7835:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789479869.208626:0:7835:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789479869.208630:0:7835:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789479869.210983:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789479869.211122:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7422f68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7833:x1876405527787776:12345-0@lo:1000: Request processed in 3855us (4073us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789479869.211136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789479869.211355:0:7833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789479869.211361:0:7833:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789479869.211377:0:7833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7833:1876405527787776:0@lo:1000: 00010000:00010000:2.0:1789479869.701306:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789479869.719805:0:7879:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479869.719999:0:7879:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789479870.724394:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789479870.753538:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc810b490 20000000:00000080:0.0:1789479870.753554:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6abb041800 uarg=0000000000000000 20000000:01000000:0.0:1789479870.753790:0:7927:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789479870.753797:0:7927:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789479870.753801:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789479870.753868:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789479870.753880:0:7927:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789479870.761648:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479870.762061:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789479870.762093:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789479870.762110:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789479870.762128:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789479870.762144:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762160:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762172:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762179:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762252:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762491:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 17 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479870.762507:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876405527787904:0@lo:104: 00000100:00100000:0.0:1789479870.762563:0:7927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479870.762622:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.762629:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479870.762636:0:7927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876405527788032:0@lo:104: 00000100:00100000:0.0:1789479870.762656:0:7927:0:(client.c:2716:ptlrpc_set_wait()) set 0000000060732d98 going to sleep for 11 seconds 00000100:00100000:3.0:1789479870.762658:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789479870.762682:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479870.762705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527787904 00000100:00100000:3.0:1789479870.762712:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527787904 00000100:00100000:0.0:1789479870.762721:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788032 00000100:00100000:0.0:1789479870.762727:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788032 00000100:00100000:3.0:1789479870.762747:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479870.762757:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c1b4248 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:7927:x1876405527787904:12345-0@lo:104: 00010000:00010000:3.0:1789479870.762769:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.762833:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479870.762838:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c1b4248 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:7927:x1876405527787904:12345-0@lo:104: Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479870.762845:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479870.762882:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789479870.762887:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000774d8db4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:7927:x1876405527788032:12345-0@lo:104: 00010000:00010000:3.0:1789479870.762894:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.762948:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789479870.762953:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000774d8db4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:7927:x1876405527788032:12345-0@lo:104: Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479870.762959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1789479870.763026:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789479870.763033:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763040:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eef63e94 already unused, calling callback (00000000680b9bb4) 10000000:00010000:1.0:1789479870.763043:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763050:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479870.763066:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479870.763072:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789479870.763106:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763113:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479870.763129:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763135:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000eef63e94/0xdaa289fda243ced0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ced7 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763146:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789479870.763148:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763153:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000405c4cdd already unused, calling callback (00000000680b9bb4) 10000000:00010000:1.0:1789479870.763160:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763166:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789479870.763172:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479870.763176:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789479870.763219:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763225:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789479870.763239:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763244:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: 00000000405c4cdd/0xdaa289fda243cde2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cde9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479870.763258:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479870.763270:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479870.763272:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479870.763283:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527788160:0@lo:103: 00000100:00100000:1.0:1789479870.763319:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479870.763355:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c17fcc0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527788288:0@lo:103: 00000100:00100000:1.0:1789479870.763375:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479870.763591:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068beab53 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876405527787904:0@lo:104: 00000100:00100000:0.0:1789479870.763602:0:7927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1876405527788032:0@lo:104: 00010000:00010000:0.0:1789479870.763620:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479870.763634:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479870.763648:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788160 00000100:00100000:2.0:1789479870.763653:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788160 00010000:00010000:2.0:1789479870.763674:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 18 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479870.763729:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788288 00000100:00100000:2.0:1789479870.763732:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788288 00010000:00010000:2.0:1789479870.763743:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 19 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479870.763771:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479870.763783:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000adcbcf42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+19:3646:x1876405527788160:12345-0@lo:103: 00010000:00010000:3.0:1789479870.763793:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479870.763798:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763807:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763817:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007deb4c9c/0xdaa289fda243ced7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243ced0 expref: 19 pid: 6515 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763830:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479870.763898:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000adcbcf42 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+18:3646:x1876405527788160:12345-0@lo:103: Request processed in 115us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479870.763904:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479870.763929:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789479870.763935:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b23235 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+17:3647:x1876405527788288:12345-0@lo:103: 00010000:00010000:3.0:1789479870.763941:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479870.763945:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763952:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763960:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000186052c0/0xdaa289fda243cde9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cde2 expref: 17 pid: 6514 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763970:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763987:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.763998:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764004:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764010:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764016:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764021:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c59d7060 already unused, calling callback (000000007e7d2c58) 00010000:00010000:3.0:1789479870.764024:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764030:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764050:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479870.764058:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479870.764086:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b23235 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+16:3647:x1876405527788288:12345-0@lo:103: Request processed in 152us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479870.764092:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789479870.764378:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.764387:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479870.764392:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c59d7060/0xdaa289fda243cf6a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479870.764621:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bd78acff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527788160:0@lo:103: 00000100:00100000:1.0:1789479870.764650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c17fcc0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527788288:0@lo:103: 00010000:00010000:1.0:1789479871.750078:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479872.200274:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479872.200300:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527788416:0@lo:41: 00000100:00100000:2.0:1789479872.200360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479872.201452:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788416 00000100:00100000:3.0:1789479872.201474:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788416 00000100:00100000:3.0:1789479872.201531:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789479872.201539:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000afe493b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527788416:12345-0@lo:41: 00000004:00000024:3.0:1789479872.201569:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789479872.201638:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000afe493b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527788416:12345-0@lo:41: Request processed in 100us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479872.201645:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479872.201721:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527788416:0@lo:41: 00010000:00010000:1.0:1789479872.778981:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479873.797503:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479874.245426:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527788544:0@lo:41: 00000100:00100000:1.0:1789479874.245522:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479874.245595:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479874.245601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fedf66b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527788672:0@lo:400: 00000100:00100000:1.0:1789479874.245633:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479874.245675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788544 00000100:00100000:1.0:1789479874.245684:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788544 00000100:00100000:1.0:1789479874.245741:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789479874.245749:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c17fcc0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527788544:12345-0@lo:41: 00000004:00000024:1.0:1789479874.245793:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789479874.245844:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c17fcc0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527788544:12345-0@lo:41: Request processed in 95us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.245852:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789479874.245901:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090a1a8f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527788544:0@lo:41: 00000100:00100000:1.0:1789479874.246018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003cea902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527788800:0@lo:400: 00000100:00100000:1.0:1789479874.246048:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479874.246068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479874.246073:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527788928:0@lo:400: 00000100:00100000:1.0:1789479874.246095:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479874.246117:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c99c4a35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527789056:0@lo:400: 00000100:00100000:1.0:1789479874.246138:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479874.246165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788800 00000100:00100000:1.0:1789479874.246169:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788800 00000100:00100000:1.0:1789479874.246222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789056 00000100:00100000:1.0:1789479874.246226:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789056 00000100:00100000:1.0:1789479874.246252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479874.246259:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd78acff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527788800:12345-0@lo:400: 00000100:00100000:1.0:1789479874.246296:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd78acff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527788800:12345-0@lo:400: Request processed in 39us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.246303:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479874.246314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479874.246320:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e1479789 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527789056:12345-0@lo:400: 00000100:00100000:1.0:1789479874.246347:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e1479789 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527789056:12345-0@lo:400: Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.246360:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789479874.246377:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788928 00000100:00100000:1.0:1789479874.246381:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788928 00000100:00100000:1.0:1789479874.246398:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479874.246403:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ac0d11a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527788928:12345-0@lo:400: 00000100:00100000:1.0:1789479874.246430:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ac0d11a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527788928:12345-0@lo:400: Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.246436:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479874.246463:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003aaa214e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527788928:0@lo:400: 00010000:00080000:1.0:1789479874.246474:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000003cea902 x1876405527788800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479874.246485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003cea902 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527788800:0@lo:400: 00010000:00080000:1.0:1789479874.246504:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c99c4a35 x1876405527789056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479874.246512:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c99c4a35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527789056:0@lo:400: 00000100:00100000:0.0:1789479874.246766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527788672 00000100:00100000:0.0:1789479874.246772:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527788672 00000100:00100000:0.0:1789479874.246809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789479874.246816:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000568948ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527788672:12345-0@lo:400: 00000100:00100000:0.0:1789479874.246868:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000568948ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527788672:12345-0@lo:400: Request processed in 54us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479874.246875:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789479874.246907:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fedf66b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527788672:0@lo:400: 10000000:01000000:3.0:1789479874.308275:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789479874.308286:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a866ce000 from 1 10000000:01000000:3.0:1789479874.308292:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479874.308345:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: 00000000661c1542/0xdaa289fda243cf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.308360:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: 00000000661c1542/0xdaa289fda243cf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.308372:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: 00000000661c1542/0xdaa289fda243cf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479874.308399:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789184:0@lo:101: 00000100:00100000:3.0:1789479874.308478:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.309214:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771c0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.310517:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789184 00000100:00100000:1.0:1789479874.310533:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789184 00000100:00100000:1.0:1789479874.310610:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789479874.310621:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf88d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527789184:12345-0@lo:101: 00010000:00010000:1.0:1789479874.310642:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479874.310667:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000405c4cdd/0xdaa289fda243cf78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf71 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479874.310702:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000405c4cdd/0xdaa289fda243cf78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479874.310739:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000405c4cdd/0xdaa289fda243cf78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479874.310753:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000405c4cdd, rc 0) 00000100:00100000:1.0:1789479874.310893:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf88d7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789184:12345-0@lo:101: Request processed in 274us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.310900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789479874.311143:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789184:0@lo:101: 00010000:00010000:3.0:1789479874.311163:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: 00000000661c1542/0xdaa289fda243cf71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.311174:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: 00000000661c1542/0xdaa289fda243cf71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479874.311321:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789312:0@lo:501: 00000100:00100000:3.0:1789479874.311369:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.311402:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000771c0abb going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.311524:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789312 00000100:00100000:1.0:1789479874.311529:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789312 00000100:00100000:1.0:1789479874.311576:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789479874.311583:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000507d7db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789312:12345-0@lo:501: 00000100:00100000:1.0:1789479874.311741:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000507d7db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789312:12345-0@lo:501: Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.311748:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789479874.311870:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000802f2947 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789312:0@lo:501: 00000100:00100000:2.0:1789479874.311906:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a404257 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789440:0@lo:503: 00000100:00100000:2.0:1789479874.311956:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479874.311985:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set 00000000144828a4 going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.312849:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789440 00000100:00100000:1.0:1789479874.312858:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789440 00000100:00100000:1.0:1789479874.312907:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789479874.312916:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fff22d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789440:12345-0@lo:503: 00000100:00100000:1.0:1789479874.313060:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fff22d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789440:12345-0@lo:503: Request processed in 145us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.313067:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789479874.313274:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a404257 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789440:0@lo:503: 00000100:00100000:2.0:1789479874.316268:0:8077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000098ad2603 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8077:1876405527789568:0@lo:502: 00000100:00100000:2.0:1789479874.316376:0:8077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479874.316432:0:8077:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8de97bb going to sleep for 11 seconds 00000100:00100000:3.0:1789479874.316622:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789568 00000100:00100000:3.0:1789479874.316640:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789568 00000100:00100000:3.0:1789479874.316702:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789479874.316710:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000773095d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:8077:x1876405527789568:12345-0@lo:502: 00000100:00100000:3.0:1789479874.316851:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000773095d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:8077:x1876405527789568:12345-0@lo:502: Request processed in 141us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479874.316859:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789479874.317160:0:8077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000098ad2603 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8077:1876405527789568:0@lo:502: 00000020:01000000:0.0:1789479874.317227:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479874.317239:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479874.317252:0:8077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789479874.317414:0:8077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6a866ce000 00000020:00000080:0.0:1789479874.317419:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789479874.317473:0:8077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8077:1876405527789696:0@lo:502: 00000100:00100000:0.0:1789479874.317658:0:8077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479874.317696:0:8077:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9aa6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479874.318136:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789696 00000100:00100000:2.0:1789479874.318144:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789696 00000100:00100000:2.0:1789479874.318207:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789479874.318217:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:8077:x1876405527789696:12345-0@lo:502: 00000100:00100000:2.0:1789479874.318360:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:8077:x1876405527789696:12345-0@lo:502: Request processed in 144us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479874.318369:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789479874.318406:0:8077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8077:1876405527789696:0@lo:502: 00000020:01000000:1.0:1789479874.318434:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479874.318441:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479874.318443:0:8077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789479874.318449:0:8077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789479874.318594:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789479874.318618:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789479874.318630:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.318644:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479874.318656:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789479874.318659:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a83cfb000 from 1 10000000:01000000:3.0:1789479874.318662:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479874.318694:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.318703:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.318831:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479874.318859:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789824:0@lo:101: 00000100:00100000:3.0:1789479874.318894:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.318929:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789479874.318981:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789824 00000100:00100000:2.0:1789479874.318986:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789824 00000100:00100000:2.0:1789479874.319052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479874.319060:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527789824:12345-0@lo:101: 00010000:00010000:2.0:1789479874.319070:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479874.319083:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cf7f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.319107:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.319117:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.319126:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a000, rc 0) 00000100:00100000:2.0:1789479874.319164:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527789824:12345-0@lo:101: Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479874.319170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789479874.319281:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789824:0@lo:101: 00010000:00010000:3.0:1789479874.319295:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479874.319305:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479874.319361:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789952:0@lo:501: 00000100:00100000:3.0:1789479874.319386:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.319581:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.319602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527789952 00000100:00100000:1.0:1789479874.319607:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527789952 00000100:00100000:1.0:1789479874.319633:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789479874.319640:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527789952:12345-0@lo:501: 00000100:00100000:1.0:1789479874.319763:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527789952:12345-0@lo:501: Request processed in 124us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.319769:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789479874.319904:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527789952:0@lo:501: 00000100:00100000:3.0:1789479874.319935:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527790080:0@lo:503: 00000100:00100000:3.0:1789479874.319975:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.320036:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.320068:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790080 00000100:00100000:1.0:1789479874.320072:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790080 00000100:00100000:1.0:1789479874.320140:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789479874.320147:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527790080:12345-0@lo:503: 00000100:00100000:1.0:1789479874.320279:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527790080:12345-0@lo:503: Request processed in 131us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.320285:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789479874.320661:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527790080:0@lo:503: 00000100:00100000:3.0:1789479874.321089:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8078:1876405527790208:0@lo:502: 00000100:00100000:3.0:1789479874.321135:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479874.321481:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790208 00000100:00100000:2.0:1789479874.321488:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790208 00000100:00100000:3.0:1789479874.321559:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479874.321561:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479874.321571:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:8078:x1876405527790208:12345-0@lo:502: 00000100:00100000:2.0:1789479874.321681:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:8078:x1876405527790208:12345-0@lo:502: Request processed in 111us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479874.321687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789479874.321757:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8078:1876405527790208:0@lo:502: 00000020:01000000:3.0:1789479874.321785:0:8078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479874.321797:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479874.321800:0:8078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789479874.321807:0:8078:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6a83cfb000 00000020:00000080:3.0:1789479874.321815:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789479874.321841:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8078:1876405527790336:0@lo:502: 00000100:00100000:3.0:1789479874.321874:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479874.321900:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479874.321911:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790336 00000100:00100000:1.0:1789479874.321915:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790336 00000100:00100000:1.0:1789479874.321945:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789479874.321952:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:8078:x1876405527790336:12345-0@lo:502: 00000100:00100000:1.0:1789479874.322042:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:8078:x1876405527790336:12345-0@lo:502: Request processed in 90us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479874.322049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789479874.322120:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8078:1876405527790336:0@lo:502: 00000020:01000000:3.0:1789479874.322138:0:8078:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479874.322143:0:8078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479874.322144:0:8078:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789479874.322147:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789479874.322537:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789479874.322560:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479874.322571:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479874.322584:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479874.826912:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479875.851777:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479876.868334:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479877.319796:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479877.319821:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527790464:0@lo:41: 00000100:00100000:1.0:1789479877.319885:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479877.319945:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790464 00000100:00100000:1.0:1789479877.319952:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790464 00000100:00100000:1.0:1789479877.319998:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479877.320007:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527790464:12345-0@lo:41: 00000004:00000024:1.0:1789479877.320046:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789479877.320090:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527790464:12345-0@lo:41: Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479877.320097:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479877.320727:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527790464:0@lo:41: 00010000:00010000:2.0:1789479877.892652:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479878.922478:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479879.364593:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527790592:0@lo:400: 00000100:00100000:2.0:1789479879.364672:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479879.364718:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527791104:0@lo:400: 00000100:00100000:2.0:1789479879.364748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479879.364778:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479879.364790:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527790720:0@lo:400: 00000100:00100000:2.0:1789479879.364849:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479879.364890:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527790848:0@lo:400: 00000100:00100000:2.0:1789479879.364921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479879.364947:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479879.364952:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527790976:0@lo:400: 00000100:00100000:2.0:1789479879.364981:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479879.365017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790592 00000100:00100000:2.0:1789479879.365031:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790592 00000100:00100000:2.0:1789479879.365088:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789479879.365098:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:3647:x1876405527790592:12345-0@lo:400: 00000100:00100000:2.0:1789479879.365160:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:3647:x1876405527790592:12345-0@lo:400: Request processed in 64us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479879.365167:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789479879.365252:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791104 00000100:00100000:2.0:1789479879.365255:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791104 00000100:00100000:2.0:1789479879.365288:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790848 00000100:00100000:2.0:1789479879.365291:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790848 00000100:00100000:2.0:1789479879.365315:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789479879.365328:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527791104:12345-0@lo:400: 00000100:00100000:2.0:1789479879.365382:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527791104:12345-0@lo:400: Request processed in 54us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479879.365389:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789479879.365402:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479879.365417:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790720 00000100:00100000:3.0:1789479879.365423:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790720 00000100:00100000:2.0:1789479879.365429:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527790848:12345-0@lo:400: 00000100:00100000:3.0:1789479879.365456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527790976 00000100:00100000:3.0:1789479879.365460:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527790976 00000100:00100000:3.0:1789479879.365478:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479879.365484:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527790848:12345-0@lo:400: Request processed in 73us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479879.365490:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527790720:12345-0@lo:400: 00000100:00100000:2.0:1789479879.365495:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479879.365535:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527790720:12345-0@lo:400: Request processed in 50us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479879.365543:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479879.365557:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527790848:0@lo:400: 00000100:00100000:3.0:1789479879.365560:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479879.365568:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527790976:12345-0@lo:400: 00010000:00080000:2.0:1789479879.365607:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6a8669ca80 x1876405527790720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479879.365617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527790720:0@lo:400: 00000100:00100000:2.0:1789479879.365632:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527790592:0@lo:400: 00000100:00100000:2.0:1789479879.365641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527791104:0@lo:400: 00000100:00100000:3.0:1789479879.365771:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527790976:12345-0@lo:400: Request processed in 203us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479879.365778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789479879.374650:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6a8669dc00 x1876405527790976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479895 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479879.374669:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527790976:0@lo:400: 00000100:00100000:2.0:1789479879.383770:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527791232:0@lo:41: 00000100:00100000:2.0:1789479879.383924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479879.388878:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791232 00000100:00100000:1.0:1789479879.388892:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791232 00000100:00100000:3.0:1789479879.389067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479879.389079:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527791232:12345-0@lo:41: 00000004:00000024:3.0:1789479879.389120:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789479879.389764:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527791232:12345-0@lo:41: Request processed in 678us (5831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479879.389792:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789479879.389986:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527791232:0@lo:41: 00010000:00010000:3.0:1789479879.941561:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479880.967818:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789479881.080890:0:8428:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789479881.080893:0:8428:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789479881.080894:0:8428:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789479881.081039:0:8428:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a6abb3b8000 00000020:01000004:3.0:1789479881.081053:0:8428:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789479881.081064:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789479881.081077:0:8428:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a6a85e2b380) 00000020:00000080:3.0:1789479881.081092:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789479881.157137:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789479881.157225:0:8428:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789479881.189668:0:8428:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789479881.190178:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789479881.190286:0:8428:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789479881.190297:0:8428:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdaa289fda243cf94 00000020:01000004:3.0:1789479881.190304:0:8428:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789479881.190324:0:8428:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789479881.190327:0:8428:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789479881.190333:0:8428:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789479881.190338:0:8428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789479881.190349:0:8428:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a6a85e28000) 00000020:00000080:3.0:1789479881.190359:0:8428:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789479881.191847:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789479881.192029:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789479881.192035:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789479881.194814:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479881.194830:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789479881.197237:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789479881.197247:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789479881.208726:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789479881.208889:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789479881.208895:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789479881.209570:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789479881.209593:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789479881.242063:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479881.242596:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789479881.242604:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789479881.251584:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789479881.251598:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789479881.252530:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789479881.252539:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789479881.258606:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479881.258782:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789479881.258788:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789479881.259821:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789479881.259830:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789479881.294271:0:8428:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789479881.295070:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789479881.295077:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789479881.296172:0:8428:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789479881.296181:0:8428:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789479881.296585:0:8428:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789479881.296610:0:8428:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789479881.296616:0:8428:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789479881.308808:0:8428:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789479881.308860:0:8428:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789479881.308864:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789479881.308866:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479881.308868:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479881.308869:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479881.308870:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479881.308872:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479881.308874:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479881.308875:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479881.308877:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479881.308879:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479881.308880:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479881.308885:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789479881.308887:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789479881.308889:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479881.308892:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479881.308893:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479881.308899:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479881.308900:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479881.308901:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479881.308902:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479881.308903:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479881.308904:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479881.308905:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479881.308936:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789479881.308957:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527791360:0@lo:253: 00000100:00100000:2.0:1789479881.309101:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.309253:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9951b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.309378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791360 00000100:00100000:1.0:1789479881.309386:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791360 00000100:00100000:1.0:1789479881.309477:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789479881.309487:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:8428:x1876405527791360:12345-0@lo:253: 20000000:01000000:1.0:1789479881.309531:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789479881.309535:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789479881.309549:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789479881.309553:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789479881.309718:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479881.309845:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789479881.309858:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789479881.309872:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789479881.309877:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789479881.309888:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789479881.309900:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789479881.310170:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789479881.310187:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1789479881.310204:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1789479881.310234:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789479881.310253:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789479881.310270:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789479881.310276:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1789479881.310287:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789479881.310293:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789479881.310306:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789479881.310322:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789479881.310389:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1789479881.310401:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1789479881.310402:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1789479881.310416:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1789479881.310422:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789479881.310434:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1789479881.310438:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1789479881.310448:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1789479881.310452:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789479881.310477:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1789479881.310492:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1789479881.310830:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1789479881.310843:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:1.0:1789479881.310845:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:1.0:1789479881.310859:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1789479881.310865:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789479881.310877:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1789479881.310882:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:1.0:1789479881.310893:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1789479881.310898:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789479881.310909:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1789479881.310921:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1789479881.310934:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789479881.310942:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789479881.310945:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789479881.311332:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789479881.311335:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479881.311699:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479881.311740:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479881.311753:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789479881.311925:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789479881.311942:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789479881.311953:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789479881.311961:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789479881.311962:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479881.312275:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479881.312293:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479881.312305:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789479881.312432:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789479881.312448:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789479881.312460:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789479881.312466:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789479881.312468:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789479881.312788:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789479881.312906:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789479881.312923:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789479881.312945:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789479881.312953:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789479881.312955:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479881.313323:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479881.313340:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479881.313352:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789479881.313468:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789479881.313484:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789479881.313496:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:1.0:1789479881.313509:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789479881.313527:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313545:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313554:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cede expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313562:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313574:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313581:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313588:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313622:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313636:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.313649:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791488:0@lo:104: 00000100:00100000:1.0:1789479881.313702:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479881.313753:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313760:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 18 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.313768:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791616:0@lo:104: 00000100:00100000:1.0:1789479881.313786:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479881.313891:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.313900:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.313914:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791744:0@lo:104: 00000100:00100000:1.0:1789479881.313935:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479881.314183:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.314239:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 18 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.314248:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791872:0@lo:104: 00000100:00100000:1.0:1789479881.314279:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.317516:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791488 00000100:00100000:0.0:1789479881.317529:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791488 00000100:00100000:0.0:1789479881.317587:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791616 00000100:00100000:0.0:1789479881.317589:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791616 00000100:00100000:0.0:1789479881.317597:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791744 00000100:00100000:0.0:1789479881.317599:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791744 00000100:00100000:0.0:1789479881.317613:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479881.317621:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527791488:12345-0@lo:104: 00010000:00010000:0.0:1789479881.317636:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.317814:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479881.317821:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527791488:12345-0@lo:104: Request processed in 200us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.317828:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479881.317844:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479881.317850:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527791616:12345-0@lo:104: 00010000:00010000:0.0:1789479881.317857:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318098:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479881.318105:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527791616:12345-0@lo:104: Request processed in 255us (4317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.318112:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479881.318127:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789479881.318133:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527791744:12345-0@lo:104: 00010000:00010000:0.0:1789479881.318141:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318171:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789479881.318175:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527791744:12345-0@lo:104: Request processed in 43us (4240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.318181:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789479881.318478:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789479881.318485:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318492:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81486400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.318496:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318503:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.318510:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.318516:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.318565:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318571:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.318591:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318597:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81486400/0xdaa289fda243cf5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf63 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318613:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789479881.318616:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318621:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.318624:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318630:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.318635:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.318640:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.318650:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318655:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.318659:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318675:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243cf32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf39 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318698:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479881.318700:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318706:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.318708:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318714:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.318721:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.318726:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.318741:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318746:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.318759:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318766:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243cf16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf1d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.318775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.318781:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.318783:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479881.318804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792000:0@lo:103: 00000100:00100000:0.0:1789479881.318840:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.318871:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479881.318876:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792128:0@lo:103: 00000100:00100000:0.0:1789479881.318904:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.318924:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527792256:0@lo:103: 00000100:00100000:0.0:1789479881.318940:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.319031:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792000 00000100:00100000:0.0:1789479881.319037:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792000 00010000:00010000:0.0:1789479881.319056:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 19 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479881.319072:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792128 00000100:00100000:0.0:1789479881.319074:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792128 00010000:00010000:0.0:1789479881.319083:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 20 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479881.319092:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792256 00000100:00100000:0.0:1789479881.319094:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792256 00010000:00010000:0.0:1789479881.319101:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 21 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479881.319111:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479881.319116:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+21:3645:x1876405527792000:12345-0@lo:103: 00010000:00010000:0.0:1789479881.319126:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479881.319131:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 21 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319151:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 21 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319166:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479881.319221:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+21:3645:x1876405527792000:12345-0@lo:103: Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.319227:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479881.319239:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479881.319245:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+20:3645:x1876405527792128:12345-0@lo:103: 00010000:00010000:0.0:1789479881.319323:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479881.319328:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 20 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319337:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 20 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319346:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479881.319369:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+20:3645:x1876405527792128:12345-0@lo:103: Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.319374:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479881.319386:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789479881.319392:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+19:3647:x1876405527792256:12345-0@lo:103: 00010000:00010000:0.0:1789479881.319398:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479881.319402:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 19 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319411:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 19 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.319426:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479881.319449:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+19:3647:x1876405527792256:12345-0@lo:103: Request processed in 57us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.319455:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789479881.319484:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792128:0@lo:103: 00000100:00100000:0.0:1789479881.319491:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792000:0@lo:103: 00000100:00100000:0.0:1789479881.319512:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527792256:0@lo:103: 00010000:00010000:3.0:1789479881.319735:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479881.319822:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.319833:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 18 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.319843:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527792384:0@lo:104: 00000100:00100000:1.0:1789479881.319866:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.319929:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829fff00 going to sleep for 11 seconds 00010000:00010000:1.0:1789479881.319941:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487a00/0xdaa289fda243cf63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf5c expref: 18 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.319952:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791488:0@lo:104: 00010000:00010000:1.0:1789479881.319960:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7a00/0xdaa289fda243cf39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf32 expref: 17 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.319978:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791616:0@lo:104: 00010000:00010000:1.0:1789479881.319986:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243cf1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf16 expref: 16 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.320000:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fa300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791744:0@lo:104: 00000100:00100000:3.0:1789479881.320078:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527791872 00000100:00100000:3.0:1789479881.320083:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527791872 00000100:00100000:3.0:1789479881.320103:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792384 00000100:00100000:3.0:1789479881.320105:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792384 00000100:00100000:3.0:1789479881.320114:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479881.320120:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527791872:12345-0@lo:104: 00010000:00010000:3.0:1789479881.320129:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320180:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479881.320185:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527791872:12345-0@lo:104: Request processed in 66us (5906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.320221:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479881.320233:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479881.320238:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527792384:12345-0@lo:104: 00010000:00010000:3.0:1789479881.320244:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320280:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789479881.320285:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527792384:12345-0@lo:104: Request processed in 48us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.320296:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789479881.320306:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479881.320311:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320318:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479881.320322:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320330:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479881.320337:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.320342:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479881.320365:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320371:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479881.320385:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320391:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243cede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cee5 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320401:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479881.320404:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320420:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479881.320422:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320429:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479881.320435:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.320439:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479881.320453:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320458:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479881.320469:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320475:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243ce67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243ce6e expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320490:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479881.320492:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479881.320493:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479881.320508:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527792512:0@lo:103: 00000100:00100000:3.0:1789479881.320532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.320561:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792640:0@lo:103: 00000100:00100000:3.0:1789479881.320580:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.320773:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792512 00000100:00100000:3.0:1789479881.320777:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792512 00010000:00010000:3.0:1789479881.320792:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 16 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.320808:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792640 00000100:00100000:3.0:1789479881.320810:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792640 00010000:00010000:3.0:1789479881.320817:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 17 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.320828:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479881.320833:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+17:3648:x1876405527792512:12345-0@lo:103: 00010000:00010000:3.0:1789479881.320840:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479881.320845:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 17 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320854:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 17 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320866:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479881.320888:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+17:3648:x1876405527792512:12345-0@lo:103: Request processed in 56us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.320894:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479881.320904:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479881.320909:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa24b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527792640:12345-0@lo:103: 00010000:00010000:3.0:1789479881.320914:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479881.320918:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 16 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320926:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 16 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320942:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.320950:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321028:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321036:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321043:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321050:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321056:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81474c00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789479881.321060:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321068:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321076:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.321085:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479881.321114:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa24b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527792640:12345-0@lo:103: Request processed in 204us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.321128:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479881.321183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527792512:0@lo:103: 00000100:00100000:3.0:1789479881.321234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527792640:0@lo:103: 00010000:00010000:1.0:1789479881.321341:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6c00/0xdaa289fda243cee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cede expref: 15 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.321352:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527791872:0@lo:104: 00010000:00010000:1.0:1789479881.321360:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81486800/0xdaa289fda243ce6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243ce67 expref: 14 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.321369:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527792384:0@lo:104: 00010000:00010000:1.0:1789479881.321388:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.321396:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.321402:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.321409:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81474c00/0xdaa289fda243cfa2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789479881.321424:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1789479881.323045:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479881.323431:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+13:8428:x1876405527791360:12345-0@lo:253: Request processed in 13942us (14327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.323441:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789479881.323521:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527791360:0@lo:253: 10000000:01000000:2.0:1789479881.323533:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789479881.323537:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789479881.323538:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789479881.323540:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479881.323541:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789479881.323542:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479881.323544:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479881.323545:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479881.323546:0:8428:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789479881.323548:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479881.323549:0:8428:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789479881.323565:0:8428:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6abb3b8000 from lustre-OST0000 10000000:01000000:2.0:1789479881.323640:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789479881.323643:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789479881.323650:0:8428:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a6a95c999c0 local copy 10000000:01000000:2.0:1789479881.323654:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789479881.323683:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.323693:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.323715:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.323731:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527792768:0@lo:101: 00000100:00100000:2.0:1789479881.323760:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.323792:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab99513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.323828:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792768 00000100:00100000:1.0:1789479881.323834:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792768 00000100:00100000:1.0:1789479881.323867:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789479881.323880:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+13:8428:x1876405527792768:12345-0@lo:101: 00010000:00010000:1.0:1789479881.323890:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479881.323901:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cfa9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.323921:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cfa9 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.323931:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfa9 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.323939:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81475400, rc 0) 00000100:00100000:1.0:1789479881.324061:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+14:8428:x1876405527792768:12345-0@lo:101: Request processed in 181us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.324067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789479881.324185:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527792768:0@lo:101: 00010000:00010000:3.0:1789479881.324416:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.324425:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.324745:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527792896:0@lo:501: 00000100:00100000:3.0:1789479881.324773:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.324825:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.324851:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527792896 00000100:00100000:1.0:1789479881.324855:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527792896 00000100:00100000:1.0:1789479881.324906:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789479881.324912:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:8428:x1876405527792896:12345-0@lo:501: 00000100:00100000:1.0:1789479881.324998:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:8428:x1876405527792896:12345-0@lo:501: Request processed in 86us (224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789479881.325004:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789479881.325133:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527792896:0@lo:501: 10000000:01000000:3.0:1789479881.325145:0:8428:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789479881.325159:0:8428:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789479881.325164:0:8428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325172:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325180:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325320:0:8428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789479881.325348:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6abb3b8000 10000000:01000000:3.0:1789479881.325352:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789479881.325357:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789479881.325360:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789479881.325364:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789479881.325367:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789479881.325383:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325391:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325399:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.325410:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793024:0@lo:101: 00000100:00100000:3.0:1789479881.325433:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.325456:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.325490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793024 00000100:00100000:2.0:1789479881.325494:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793024 00000100:00100000:2.0:1789479881.325520:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789479881.325526:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+14:8428:x1876405527793024:12345-0@lo:101: 00010000:00010000:2.0:1789479881.325534:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479881.325544:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cfb7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.325558:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.325567:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.325575:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789479881.325714:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793024:12345-0@lo:101: Request processed in 187us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.325720:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789479881.325770:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793024:0@lo:101: 00010000:00010000:3.0:1789479881.325780:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.325789:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.325837:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793152:0@lo:501: 00000100:00100000:3.0:1789479881.325857:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.325876:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.325908:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793152 00000100:00100000:1.0:1789479881.325912:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793152 00000100:00100000:1.0:1789479881.325936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789479881.325941:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793152:12345-0@lo:501: 00000100:00100000:1.0:1789479881.326088:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793152:12345-0@lo:501: Request processed in 146us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.326103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789479881.326175:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793152:0@lo:501: 00000100:00100000:3.0:1789479881.326236:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793280:0@lo:503: 00000100:00100000:3.0:1789479881.326268:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.326280:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.326325:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793280 00000100:00100000:2.0:1789479881.326329:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793280 00000100:00100000:2.0:1789479881.326348:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789479881.326353:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793280:12345-0@lo:503: 00000100:00100000:2.0:1789479881.326432:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793280:12345-0@lo:503: Request processed in 78us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.326438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789479881.326522:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793280:0@lo:503: 00000040:00080000:3.0:1789479881.326774:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789479881.326831:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793408:0@lo:502: 00000100:00100000:3.0:1789479881.326858:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.326885:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.326922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793408 00000100:00100000:2.0:1789479881.326926:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793408 00000100:00100000:2.0:1789479881.326953:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789479881.326958:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793408:12345-0@lo:502: 00000100:00100000:2.0:1789479881.327098:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793408:12345-0@lo:502: Request processed in 139us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.327104:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789479881.327163:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793408:0@lo:502: 00000040:00080000:1.0:1789479881.327369:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789479881.327392:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789479881.327404:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789479881.327415:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789479881.327426:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789479881.327437:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789479881.327454:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793536:0@lo:502: 00000100:00100000:1.0:1789479881.327484:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.327500:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.327701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793536 00000100:00100000:2.0:1789479881.327708:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793536 00000100:00100000:2.0:1789479881.327742:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789479881.327748:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793536:12345-0@lo:502: 00000100:00100000:2.0:1789479881.327812:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793536:12345-0@lo:502: Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.327820:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789479881.327932:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793536:0@lo:502: 00000040:00080000:1.0:1789479881.328038:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789479881.328047:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789479881.328481:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789479881.328488:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789479881.328493:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479881.328495:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789479881.328501:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789479881.328514:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a6a85e13380) 00000020:00000080:1.0:1789479881.328532:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789479881.328536:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789479881.328655:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789479881.328663:0:8451:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789479881.328669:0:8451:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdaa289fda243cfcc 00010000:00010000:0.0:1789479881.329100:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479881.329109:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.329118:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.329122:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.329131:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.329138:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.329143:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.329170:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.329176:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.329235:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.329249:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243cfa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243cfb0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.329260:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.329262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.329264:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479881.331324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527793664:0@lo:103: 00000100:00100000:2.0:1789479881.331388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.331482:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793664 00000100:00100000:0.0:1789479881.331490:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793664 00000100:00100000:0.0:1789479881.331538:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479881.331546:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+15:3646:x1876405527793664:12345-0@lo:103: 00010000:00010000:0.0:1789479881.331559:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479881.331574:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243cfa9 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.331599:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479881.331634:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+14:3646:x1876405527793664:12345-0@lo:103: Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.331640:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479881.331669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527793664:0@lo:103: 00010000:00010000:1.0:1789479881.334037:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789479881.334800:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789479881.338422:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789479881.341259:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789479881.353145:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789479881.353363:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789479881.364287:0:8451:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789479881.367294:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789479881.367306:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479881.367312:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.367314:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789479881.367318:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479881.367323:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.367324:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789479881.367327:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789479881.367329:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789479881.367353:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479881.367357:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.367358:0:8451:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789479881.367361:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789479881.369144:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789479881.369182:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789479881.369231:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369244:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479881.369253:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8000 from 1 10000000:01000000:1.0:1789479881.369256:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789479881.369304:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369313:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369324:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.369346:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793792:0@lo:101: 00000100:00100000:1.0:1789479881.369408:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.369454:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.369480:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793792 00000100:00100000:1.0:1789479881.369488:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793792 00000100:00100000:1.0:1789479881.369529:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789479881.369538:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:8428:x1876405527793792:12345-0@lo:101: 00010000:00010000:1.0:1789479881.369553:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479881.369571:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cfd3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369597:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369609:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369617:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81475400, rc 0) 00000100:00100000:1.0:1789479881.369656:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793792:12345-0@lo:101: Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.369663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789479881.369707:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793792:0@lo:101: 00010000:00010000:1.0:1789479881.369720:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.369730:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.369808:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793920:0@lo:501: 00000100:00100000:1.0:1789479881.369833:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.369855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527793920 00000100:00100000:1.0:1789479881.369859:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527793920 00000100:00100000:1.0:1789479881.369879:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789479881.369885:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793920:12345-0@lo:501: 00000100:00100000:1.0:1789479881.371787:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527793920:12345-0@lo:501: Request processed in 79us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.371803:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789479881.371866:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.371889:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527793920:0@lo:501: 00000100:00100000:1.0:1789479881.371944:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794048:0@lo:503: 00000100:00100000:1.0:1789479881.372065:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.372100:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ed0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.372223:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794048 00000100:00100000:0.0:1789479881.372229:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794048 00000100:00100000:0.0:1789479881.372262:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789479881.372269:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794048:12345-0@lo:503: 00000100:00100000:0.0:1789479881.372369:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794048:12345-0@lo:503: Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.372375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789479881.372463:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794048:0@lo:503: 00000040:00080000:1.0:1789479881.372734:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789479881.372807:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794176:0@lo:502: 00000100:00100000:1.0:1789479881.372844:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.373769:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.381122:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794176 00000100:00100000:0.0:1789479881.381137:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794176 00000100:00100000:0.0:1789479881.381287:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789479881.381298:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794176:12345-0@lo:502: 00000100:00100000:0.0:1789479881.381458:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794176:12345-0@lo:502: Request processed in 161us (8613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.381465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789479881.385769:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794176:0@lo:502: 00000040:00080000:1.0:1789479881.386001:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789479881.386031:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789479881.386063:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794304:0@lo:502: 00000100:00100000:1.0:1789479881.386127:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.386233:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.387359:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794304 00000100:00100000:2.0:1789479881.387370:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794304 00000100:00100000:2.0:1789479881.387455:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789479881.387465:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794304:12345-0@lo:502: 00000100:00100000:2.0:1789479881.387603:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794304:12345-0@lo:502: Request processed in 139us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.387611:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789479881.388834:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794304:0@lo:502: 00000040:00080000:3.0:1789479881.388924:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789479881.388936:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789479881.390676:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479881.390686:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.390688:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789479881.390695:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6abb3b8000 00000020:00000080:3.0:1789479881.390697:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789479881.390716:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479881.390719:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.390721:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789479881.390724:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789479881.390781:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789479881.390805:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789479881.390861:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.390873:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479881.390920:0:8428:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789479881.390922:0:8428:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6abb3b8000 10000000:01000000:1.0:1789479881.390926:0:8428:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6abb3b8000 10000000:01000000:1.0:1789479881.390934:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789479881.390940:0:8428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6abb3b8000 from 1 10000000:01000000:1.0:1789479881.390942:0:8428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789479881.392087:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.392100:0:8428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.392112:0:8428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.392136:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794432:0@lo:101: 00000100:00100000:1.0:1789479881.392219:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.392249:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a89cb5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.392316:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794432 00000100:00100000:2.0:1789479881.392322:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794432 00000100:00100000:2.0:1789479881.392366:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789479881.392375:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8428:x1876405527794432:12345-0@lo:101: 00010000:00010000:2.0:1789479881.392387:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479881.392399:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243cfe1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.392421:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.392431:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.392440:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b600, rc 0) 00000100:00100000:2.0:1789479881.392478:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794432:12345-0@lo:101: Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.392484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789479881.394126:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794432:0@lo:101: 00010000:00010000:3.0:1789479881.394149:0:8428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.394161:0:8428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.394328:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794560:0@lo:501: 00000100:00100000:2.0:1789479881.394372:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.394403:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9951c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.394463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794560 00000100:00100000:1.0:1789479881.394469:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794560 00000100:00100000:1.0:1789479881.394506:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789479881.394514:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794560:12345-0@lo:501: 00000100:00100000:1.0:1789479881.394616:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794560:12345-0@lo:501: Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.394623:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789479881.395090:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794560:0@lo:501: 00000100:00100000:3.0:1789479881.395120:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794688:0@lo:503: 00000100:00100000:3.0:1789479881.395166:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.395278:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.395305:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794688 00000100:00100000:1.0:1789479881.395311:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794688 00000100:00100000:1.0:1789479881.395343:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789479881.395351:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794688:12345-0@lo:503: 00000100:00100000:1.0:1789479881.395431:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794688:12345-0@lo:503: Request processed in 81us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.395438:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789479881.396297:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794688:0@lo:503: 00000040:00080000:3.0:1789479881.396547:0:8428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789479881.396615:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794816:0@lo:502: 00000100:00100000:2.0:1789479881.396753:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.396789:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.400098:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794816 00000100:00100000:1.0:1789479881.400113:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794816 00000100:00100000:1.0:1789479881.400161:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789479881.400170:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794816:12345-0@lo:502: 00000100:00100000:1.0:1789479881.400350:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794816:12345-0@lo:502: Request processed in 180us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.400357:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789479881.400462:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794816:0@lo:502: 00000040:00080000:2.0:1789479881.400707:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789479881.400737:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789479881.400751:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789479881.400763:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789479881.400776:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789479881.400800:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789479881.400812:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789479881.400824:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789479881.400836:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789479881.400848:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789479881.400860:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789479881.400871:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789479881.400881:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789479881.400891:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789479881.400901:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789479881.400922:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789479881.400933:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789479881.400943:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789479881.400954:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789479881.400977:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789479881.400991:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789479881.401003:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789479881.401015:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789479881.401026:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789479881.401043:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789479881.401176:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789479881.401219:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789479881.401237:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789479881.401248:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789479881.401259:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789479881.401269:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789479881.401292:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789479881.401304:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789479881.401315:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789479881.401325:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789479881.401337:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789479881.401347:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789479881.401378:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794944:0@lo:502: 00000100:00100000:2.0:1789479881.401424:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.401449:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9951c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.402066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527794944 00000100:00100000:0.0:1789479881.402074:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527794944 00000100:00100000:0.0:1789479881.402109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789479881.402116:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794944:12345-0@lo:502: 00000100:00100000:0.0:1789479881.402250:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527794944:12345-0@lo:502: Request processed in 134us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.402258:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789479881.402346:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527794944:0@lo:502: 00000040:00080000:2.0:1789479881.402391:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789479881.402399:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789479881.403900:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789479881.403915:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a6ab9ba19c0) 00000020:00000080:2.0:1789479881.403935:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1789479881.404096:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789479881.404100:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789479881.404103:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8000 3 00010000:00080000:2.0:1789479881.404143:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6ab98f3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789479881.407912:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1789479881.408564:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789479881.408627:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789479881.408640:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdaa289fda243cff6 00000100:00080000:2.0:1789479881.408650:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789479881.408662:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a6ab98f3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789479881.408694:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6abb505f80 x1876405527795072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789479881.408713:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789479881.408811:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527795456:0@lo:400: 00000100:00100000:2.0:1789479881.408872:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.408909:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479881.408915:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527795584:0@lo:400: 00000100:00100000:2.0:1789479881.408940:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.409696:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527795200:0@lo:400: 00000100:00100000:3.0:1789479881.409731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.409754:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479881.409760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527795328:0@lo:400: 00000100:00100000:3.0:1789479881.409784:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.409822:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795456 00000100:00100000:3.0:1789479881.409830:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795456 00000100:00100000:3.0:1789479881.409865:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795200 00000100:00100000:3.0:1789479881.409867:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795200 00000100:00100000:3.0:1789479881.409894:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479881.409901:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527795456:12345-0@lo:400: 00000100:00100000:3.0:1789479881.409945:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527795456:12345-0@lo:400: Request processed in 44us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.409951:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479881.409965:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479881.409971:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527795200:12345-0@lo:400: 00000100:00100000:3.0:1789479881.409999:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527795200:12345-0@lo:400: Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.410004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479881.410021:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795584 00000100:00100000:3.0:1789479881.410025:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795584 00000100:00100000:3.0:1789479881.410042:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795328 00000100:00100000:3.0:1789479881.410045:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795328 00000100:00100000:3.0:1789479881.410068:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789479881.410075:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527795584:12345-0@lo:400: 00000100:00100000:3.0:1789479881.410104:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527795584:12345-0@lo:400: Request processed in 30us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.410107:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527795072:0@lo:38: 00000100:00100000:3.0:1789479881.410109:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789479881.410120:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789479881.410125:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527795328:12345-0@lo:400: 00000100:00100000:0.0:1789479881.410138:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.410146:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527795328:12345-0@lo:400: Request processed in 21us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.410151:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789479881.410165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795072 00000100:00100000:3.0:1789479881.410168:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795072 00000100:00100000:3.0:1789479881.410180:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479881.410184:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527795072:12345-0@lo:38: 00010000:00080000:3.0:1789479881.410244:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:3.0:1789479881.410273:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdaa289fda243cffd 00000004:00100000:3.0:1789479881.410285:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789479881.410313:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8a6abb487800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479881.410358:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876405527795072:12345-0@lo:38: Request processed in 162us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.410365:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479881.410402:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527795328:0@lo:400: 00010000:00080000:3.0:1789479881.410414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6abb504e00 x1876405527795200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.410424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527795200:0@lo:400: 00010000:00080000:3.0:1789479881.410463:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6abb505f80 x1876405527795072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.410470:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479881.410475:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789479881.410481:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789479881.410485:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789479881.410487:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789479881.410492:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527795072:0@lo:38: 00000100:00100000:3.0:1789479881.410513:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527795584:0@lo:400: 00010000:00080000:3.0:1789479881.410522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6abb504700 x1876405527795456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.410530:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527795456:0@lo:400: 00000020:01000004:2.0:1789479881.414119:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789479881.414156:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a69869819c0) 00000020:00000080:2.0:1789479881.414178:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:2.0:1789479881.414286:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789479881.414290:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789479881.414292:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8000 3 00010000:00080000:2.0:1789479881.414323:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6a95dd0800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789479881.420085:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:2.0:1789479881.420289:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789479881.420330:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789479881.420354:0:8456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdaa289fda243d00b 00000100:00080000:2.0:1789479881.423895:0:8456:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789479881.423912:0:8456:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a6a95dd0800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789479881.423976:0:8456:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6abb506680 x1876405527795712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789479881.424005:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789479881.424135:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527795712:0@lo:38: 00000100:00100000:3.0:1789479881.424224:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.424483:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795712 00000100:00100000:2.0:1789479881.424492:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795712 00000100:00100000:2.0:1789479881.424533:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789479881.424540:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527795712:12345-0@lo:38: 00010000:00080000:2.0:1789479881.424566:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:2.0:1789479881.424609:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdaa289fda243d012 00000004:00100000:2.0:1789479881.424623:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789479881.424652:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479881.424712:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876405527795712:12345-0@lo:38: Request processed in 171us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.424719:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1789479881.424801:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:3.0:1789479881.425158:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6abb506680 x1876405527795712/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.425169:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479881.425176:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789479881.425182:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789479881.425186:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789479881.425224:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd0800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789479881.425231:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527795712:0@lo:38: 00000020:01000000:0.0:1789479881.426151:0:8428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789479881.426182:0:8428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479881.426231:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.426244:0:8428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789479881.426293:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789479881.426295:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789479881.426297:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479881.426298:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479881.426299:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479881.426304:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479881.426305:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479881.426306:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479881.426308:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479881.426309:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479881.426310:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479881.426314:0:8428:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789479881.426316:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789479881.426317:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789479881.426319:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479881.426320:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479881.426321:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479881.426322:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479881.426323:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479881.426324:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479881.426325:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479881.426326:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479881.426327:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789479881.426354:0:8428:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789479881.426366:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527795840:0@lo:253: 00000100:00100000:0.0:1789479881.426412:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.426442:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.430142:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795840 00000100:00100000:2.0:1789479881.430161:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795840 00000100:00100000:2.0:1789479881.430246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789479881.430256:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527795840:12345-0@lo:253: 20000000:01000000:2.0:1789479881.430283:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789479881.430295:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789479881.442091:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789479881.442110:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789479881.442231:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789479881.442236:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789479881.442255:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442273:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442282:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442289:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442324:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442336:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.442350:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527795968:0@lo:104: 00000100:00100000:2.0:1789479881.442410:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479881.442456:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.442465:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 16 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.442483:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527796096:0@lo:104: 00000100:00100000:2.0:1789479881.442501:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aafb3f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.442650:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789479881.442667:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.442687:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527795968 00000100:00100000:0.0:1789479881.442694:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527795968 00000100:00100000:0.0:1789479881.442723:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796096 00000100:00100000:0.0:1789479881.442725:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796096 00000100:00100000:0.0:1789479881.442736:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789479881.442743:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb26f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:6536:x1876405527795968:12345-0@lo:104: 00010000:00010000:0.0:1789479881.442754:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.442794:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479881.442805:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb26f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:6536:x1876405527795968:12345-0@lo:104: Request processed in 63us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.442812:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789479881.442845:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789479881.442850:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527796096:12345-0@lo:104: 00010000:00010000:0.0:1789479881.442857:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.442884:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479881.442888:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527796096:12345-0@lo:104: Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.442893:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789479881.442906:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789479881.442911:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.442918:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81487800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.442922:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.442931:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.442938:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.442944:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.442977:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.442993:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.443013:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443019:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81487800/0xdaa289fda243cf24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf2b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443032:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789479881.443035:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443040:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81474200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479881.443044:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443051:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479881.443057:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479881.443062:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479881.443075:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443080:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479881.443085:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443090:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243cf08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf0f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.443109:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.443111:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479881.443113:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479881.443268:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479881.443295:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527795968:0@lo:104: 00000100:00100000:2.0:1789479881.443304:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527796096:0@lo:104: 00010000:00010000:2.0:1789479881.443321:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.443380:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:8428:x1876405527795840:12345-0@lo:253: Request processed in 13126us (16966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.443388:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789479881.443512:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:8428:1876405527795840:0@lo:253: 10000000:01000000:0.0:1789479881.443521:0:8428:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789479881.443524:0:8428:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479881.443527:0:8428:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789479881.443528:0:8428:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479881.443529:0:8428:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479881.443530:0:8428:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479881.443531:0:8428:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479881.443533:0:8428:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479881.443534:0:8428:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479881.443536:0:8428:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479881.443537:0:8428:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479881.443538:0:8428:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479881.443549:0:8428:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789479881.445036:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527796224:0@lo:103: 00000100:00100000:3.0:1789479881.445089:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.445141:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479881.445148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527796352:0@lo:103: 00000100:00100000:3.0:1789479881.445169:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.445504:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796224 00000100:00100000:2.0:1789479881.445511:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796224 00010000:00010000:2.0:1789479881.445540:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 16 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.445566:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796352 00000100:00100000:2.0:1789479881.445569:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796352 00010000:00010000:2.0:1789479881.445581:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 17 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.445612:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789479881.445620:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+17:3647:x1876405527796224:12345-0@lo:103: 00010000:00010000:2.0:1789479881.445634:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479881.445640:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 17 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445666:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 17 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445682:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243cf2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf24 expref: 17 pid: 6512 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445694:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479881.445737:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+16:3647:x1876405527796224:12345-0@lo:103: Request processed in 117us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.445744:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789479881.445759:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789479881.445765:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+15:3647:x1876405527796352:12345-0@lo:103: 00010000:00010000:2.0:1789479881.445773:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479881.445777:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 15 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445786:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 15 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445796:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243cf0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf08 expref: 15 pid: 6514 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445807:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445815:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789479881.445829:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003593894s 00010000:00010000:2.0:1789479881.445839:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445847:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445854:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445861:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445867:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789479881.445872:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445880:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445895:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445906:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479881.445930:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+14:3647:x1876405527796352:12345-0@lo:103: Request processed in 166us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.445937:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789479881.445968:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445976:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.445993:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d019 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.447059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527796352:0@lo:103: 00000100:00100000:2.0:1789479881.447072:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527796224:0@lo:103: 00080000:10000000:1.0:1789479881.451116:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789479881.451308:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789479881.451497:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789479881.451629:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789479881.451795:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789479881.451977:0:8428:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789479881.455709:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789479881.462929:0:8428:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789479881.462938:0:8428:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789479881.463025:0:8428:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789479881.463062:0:8428:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789479881.463081:0:8428:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789479881.463098:0:8428:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789479881.463883:0:8428:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479881.464049:0:8428:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:3.0:1789479881.849699:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789479881.849706:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a866ce000 from 30 10000000:01000000:3.0:1789479881.849711:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479881.849756:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.849768:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.849777:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.849816:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796480:0@lo:101: 00000100:00100000:3.0:1789479881.849881:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.849930:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.849958:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796480 00000100:00100000:3.0:1789479881.850792:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796480 00000100:00100000:3.0:1789479881.850855:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789479881.850864:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+14:6517:x1876405527796480:12345-0@lo:101: 00010000:00010000:3.0:1789479881.850879:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.850893:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d020 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.850919:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d020 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.850930:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d020 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.850939:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6e00, rc 0) 00000100:00100000:3.0:1789479881.851005:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527796480:12345-0@lo:101: Request processed in 142us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.851012:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789479881.851066:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796480:0@lo:101: 00010000:00010000:3.0:1789479881.851080:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.851089:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.851164:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796608:0@lo:501: 00000100:00100000:3.0:1789479881.851223:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.851248:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.851283:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796608 00000100:00100000:3.0:1789479881.851287:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796608 00000100:00100000:3.0:1789479881.851310:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789479881.851317:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527796608:12345-0@lo:501: 00000100:00100000:3.0:1789479881.851423:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527796608:12345-0@lo:501: Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.851430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789479881.851459:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796608:0@lo:501: 00000100:00100000:3.0:1789479881.851908:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796736:0@lo:503: 00000100:00100000:3.0:1789479881.851948:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.857844:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.857877:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796736 00000100:00100000:3.0:1789479881.857886:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796736 00000100:00100000:3.0:1789479881.857936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789479881.857946:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527796736:12345-0@lo:503: 00000100:00100000:3.0:1789479881.858099:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527796736:12345-0@lo:503: Request processed in 154us (6150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.858107:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789479881.858170:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527796736:0@lo:503: 00000100:00100000:3.0:1789479881.858411:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8482:1876405527796864:0@lo:502: 00000100:00100000:3.0:1789479881.858451:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.858478:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796864 00000100:00100000:3.0:1789479881.858482:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796864 00000100:00100000:3.0:1789479881.858504:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789479881.858510:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8482:x1876405527796864:12345-0@lo:502: 00000100:00100000:3.0:1789479881.858832:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:8482:x1876405527796864:12345-0@lo:502: Request processed in 321us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.858839:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789479881.858877:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.858889:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8482:1876405527796864:0@lo:502: 00000100:00100000:3.0:1789479881.858927:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8482:1876405527796992:0@lo:502: 00000100:00100000:3.0:1789479881.859020:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.859044:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527796992 00000100:00100000:3.0:1789479881.859048:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527796992 00000100:00100000:3.0:1789479881.859069:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789479881.859076:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8482:x1876405527796992:12345-0@lo:502: 00000100:00100000:3.0:1789479881.859133:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:8482:x1876405527796992:12345-0@lo:502: Request processed in 57us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.859139:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789479881.859167:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.859178:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8482:1876405527796992:0@lo:502: 00000040:00080000:3.0:1789479881.859223:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789479881.859272:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789479881.859288:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789479881.859296:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859307:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.859323:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789479881.859325:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a866ce000 from 5 10000000:01000000:3.0:1789479881.859327:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789479881.859351:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859359:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859368:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.859378:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797120:0@lo:101: 00000100:00100000:3.0:1789479881.859402:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.859421:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98330c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.859432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797120 00000100:00100000:3.0:1789479881.859435:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797120 00000100:00100000:3.0:1789479881.859456:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789479881.859462:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527797120:12345-0@lo:101: 00010000:00010000:3.0:1789479881.859470:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.859481:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d02e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859500:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d02e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859508:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d02e expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.859526:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7400, rc 0) 00000100:00100000:3.0:1789479881.861446:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527797120:12345-0@lo:101: Request processed in 1976us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.861457:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789479881.862360:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797120:0@lo:101: 00010000:00010000:0.0:1789479881.862383:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479881.862396:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479881.862466:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797248:0@lo:256: 00000100:00100000:0.0:1789479881.862514:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.862560:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.864998:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797248 00000100:00100000:3.0:1789479881.865013:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797248 00000100:00100000:3.0:1789479881.865082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789479881.865091:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527797248:12345-0@lo:256: 20000000:01000000:3.0:1789479881.865114:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789479881.865137:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789479881.865141:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789479881.865283:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527797248:12345-0@lo:256: Request processed in 193us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.865291:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789479881.865342:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797248:0@lo:256: 10000000:01000000:3.0:1789479881.865389:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789479881.865398:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865410:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.865420:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789479881.865422:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789479881.865425:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789479881.865452:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865470:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865479:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.865495:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797376:0@lo:101: 00000100:00100000:3.0:1789479881.865524:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.865762:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.865777:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797376 00000100:00100000:3.0:1789479881.865781:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797376 00000100:00100000:3.0:1789479881.865807:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789479881.865813:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527797376:12345-0@lo:101: 00010000:00010000:3.0:1789479881.865821:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.865833:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d03c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865852:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d03c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865862:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d03c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.865870:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7200, rc 0) 00000100:00100000:3.0:1789479881.865898:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527797376:12345-0@lo:101: Request processed in 85us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.865904:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789479881.865934:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797376:0@lo:101: 00010000:00010000:3.0:1789479881.865952:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.867065:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.867140:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797504:0@lo:501: 00000100:00100000:3.0:1789479881.867176:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.867231:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.867250:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797504 00000100:00100000:3.0:1789479881.867255:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797504 00000100:00100000:3.0:1789479881.867283:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789479881.867289:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527797504:12345-0@lo:501: 00000100:00100000:3.0:1789479881.867395:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527797504:12345-0@lo:501: Request processed in 105us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.867403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789479881.867438:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797504:0@lo:501: 00000100:00100000:3.0:1789479881.867462:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797632:0@lo:503: 00000100:00100000:3.0:1789479881.867499:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.867511:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.867523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797632 00000100:00100000:3.0:1789479881.867526:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797632 00000100:00100000:3.0:1789479881.871220:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789479881.871240:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527797632:12345-0@lo:503: 00000100:00100000:3.0:1789479881.871410:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527797632:12345-0@lo:503: Request processed in 177us (3908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.871419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789479881.871494:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527797632:0@lo:503: 00000100:00100000:1.0:1789479881.873724:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8483:1876405527797760:0@lo:502: 00000100:00100000:1.0:1789479881.873794:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.873866:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8856f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.876321:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797760 00000100:00100000:3.0:1789479881.876333:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797760 00000100:00100000:3.0:1789479881.876382:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789479881.876391:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:8483:x1876405527797760:12345-0@lo:502: 00000100:00100000:3.0:1789479881.876586:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:8483:x1876405527797760:12345-0@lo:502: Request processed in 196us (2791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.876593:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789479881.877501:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8483:1876405527797760:0@lo:502: 00000020:01000000:1.0:1789479881.877536:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789479881.877708:0:8483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789479881.877715:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479881.877723:0:8483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789479881.877728:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789479881.877732:0:8483:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:1.0:1789479881.877752:0:8483:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789479881.877754:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789479881.877861:0:8483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a6abb5c4d40) 00000020:00000080:1.0:1789479881.877884:0:8483:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1789479881.877889:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789479881.878033:0:8483:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789479881.878039:0:8483:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789479881.878045:0:8483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243d051 00010000:00080000:1.0:1789479881.878076:0:8483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6abb5cf000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1789479881.878347:0:8483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789479881.897390:0:8483:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789479881.897412:0:8483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789479881.898999:0:8483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479881.899298:0:8483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479881.899386:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789479881.899474:0:8483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789479881.903152:0:8484:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789479881.903160:0:8484:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789479881.907434:0:8483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789479881.907448:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789479881.907493:0:8483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789479881.907521:0:8483:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243d058 00000100:00080000:0.0:1789479881.907531:0:8483:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789479881.907674:0:8483:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a6abb5cf000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789479881.907709:0:8483:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6a866f4000 x1876405527797888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789479881.907730:0:8483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789479881.907921:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479881.907926:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479881.907928:0:8483:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789479881.907932:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479881.907936:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479881.907937:0:8483:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789479881.907941:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789479881.907943:0:8483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789479881.908096:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8483:1876405527798016:0@lo:502: 00000100:00100000:0.0:1789479881.908168:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.908272:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329840 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.909087:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527797888:0@lo:8: 00000100:00100000:3.0:1789479881.909133:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.909490:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527797888 00000100:00100000:0.0:1789479881.909498:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527797888 00000100:00100000:0.0:1789479881.909528:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479881.909535:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876405527797888:12345-0@lo:8: 00010000:00080000:0.0:1789479881.909560:0:8434:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:0.0:1789479881.909599:0:8434:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243d05f 00002000:00100000:0.0:1789479881.909629:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a6abb3cb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789479881.909633:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789479881.909637:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789479881.909693:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789479881.909906:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789479881.909930:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a6abb3cf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479881.909996:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527797888:12345-0@lo:8: Request processed in 461us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.910004:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789479881.910184:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8a6a866f4000 x1876405527797888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.910238:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479881.910245:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789479881.910251:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789479881.910256:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789479881.910258:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5cf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789479881.910272:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789479881.910275:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527797888:0@lo:8: 00000100:00100000:0.0:1789479881.910393:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527798144:0@lo:700: 00000100:00100000:0.0:1789479881.910436:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.910467:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798144 00000100:00100000:0.0:1789479881.910471:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798144 00000100:00100000:0.0:1789479881.910549:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789479881.910557:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8486:x1876405527798144:12345-0@lo:700: 00000100:00100000:0.0:1789479881.910597:0:8443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876405527798272:0@lo:700: 00000100:00100000:0.0:1789479881.910622:0:8443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.910639:0:8443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d0f480 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.910653:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329540 going to sleep for 11 seconds 00000004:00080000:0.0:1789479881.912750:0:8484:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789479881.912840:0:8484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 250836648931ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789479881.912848:0:8484:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789479881.915002:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798272 00000100:00100000:0.0:1789479881.915015:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798272 00000100:00080000:3.0:1789479881.915746:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479881.915752:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479881.916846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798016 00000100:00100000:2.0:1789479881.916856:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798016 00000100:00100000:2.0:1789479881.916903:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789479881.916912:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:8483:x1876405527798016:12345-0@lo:502: 00000100:00100000:2.0:1789479881.917076:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:8483:x1876405527798016:12345-0@lo:502: Request processed in 165us (8908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.917084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789479881.917277:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8483:1876405527798016:0@lo:502: 00000020:01000000:2.0:1789479881.917310:0:8483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479881.917317:0:8483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479881.917319:0:8483:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789479881.917325:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789479881.917896:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789479881.917917:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789479881.917927:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.917939:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.917956:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789479881.917958:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a83cfb000 from 30 10000000:01000000:3.0:1789479881.917974:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479881.918005:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918013:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918023:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.918042:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798400:0@lo:101: 00000100:00100000:3.0:1789479881.918082:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.918115:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.918138:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798400 00000100:00100000:3.0:1789479881.918143:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798400 00000100:00100000:3.0:1789479881.918180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789479881.918214:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527798400:12345-0@lo:101: 00010000:00010000:3.0:1789479881.918225:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.918236:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d066 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918256:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d066 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918267:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d066 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918285:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6800, rc 0) 00000100:00100000:3.0:1789479881.918313:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527798400:12345-0@lo:101: Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.918320:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789479881.918347:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798400:0@lo:101: 00010000:00010000:3.0:1789479881.918359:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.918367:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.918413:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798528:0@lo:501: 00000100:00100000:3.0:1789479881.918435:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.918452:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.918463:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798528 00000100:00100000:3.0:1789479881.918466:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798528 00000100:00100000:3.0:1789479881.918487:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789479881.918493:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527798528:12345-0@lo:501: 00000100:00100000:3.0:1789479881.922050:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527798528:12345-0@lo:501: Request processed in 3550us (3606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.922064:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789479881.922132:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798528:0@lo:501: 00000100:00100000:3.0:1789479881.922179:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798656:0@lo:503: 00000100:00100000:3.0:1789479881.922245:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.922273:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.923057:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798656 00000100:00100000:2.0:1789479881.923066:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798656 00000100:00100000:2.0:1789479881.923117:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789479881.923126:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527798656:12345-0@lo:503: 00000100:00100000:2.0:1789479881.923270:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527798656:12345-0@lo:503: Request processed in 145us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.923277:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789479881.924073:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789479881.924083:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876405527798272:12345-0@lo:700: 00000100:00100000:3.0:1789479881.924530:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527798656:0@lo:503: 00000004:00080000:0.0:1789479881.926368:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789479881.926517:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8487:1876405527798784:0@lo:502: 00000100:00100000:3.0:1789479881.926891:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.926992:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.927080:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798784 00000100:00100000:0.0:1789479881.927087:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798784 00000100:00100000:0.0:1789479881.927135:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789479881.927144:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:8487:x1876405527798784:12345-0@lo:502: 00000100:00100000:0.0:1789479881.927563:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:8487:x1876405527798784:12345-0@lo:502: Request processed in 419us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.927650:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 40000000:02000000:0.0:1789479881.929236:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:3.0:1789479881.930111:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8487:1876405527798784:0@lo:502: 00000100:00100000:3.0:1789479881.930182:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8487:1876405527798912:0@lo:502: 00000100:00100000:3.0:1789479881.930273:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.930307:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789479881.932380:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527798912 00000100:00100000:1.0:1789479881.932393:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527798912 00000100:00100000:1.0:1789479881.932460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789479881.932469:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:8487:x1876405527798912:12345-0@lo:502: 00000100:00100000:1.0:1789479881.932636:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:8487:x1876405527798912:12345-0@lo:502: Request processed in 168us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.932643:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789479881.932787:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8487:1876405527798912:0@lo:502: 00000040:00080000:3.0:1789479881.932820:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789479881.933674:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789479881.933697:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789479881.933706:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.933720:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479881.933743:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789479881.933746:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a83cfb000 from 5 10000000:01000000:1.0:1789479881.933748:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479881.933777:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.933786:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479881.933797:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.933815:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799040:0@lo:101: 00000100:00100000:1.0:1789479881.933858:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.933899:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8856f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.933945:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799040 00000100:00100000:3.0:1789479881.933951:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799040 00000100:00100000:3.0:1789479881.934000:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789479881.934008:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527799040:12345-0@lo:101: 00010000:00010000:3.0:1789479881.934019:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.934033:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d074 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934052:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d074 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934063:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d074 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934071:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7e00, rc 0) 00000100:00100000:3.0:1789479881.934107:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527799040:12345-0@lo:101: Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.934124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789479881.934162:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799040:0@lo:101: 00010000:00010000:3.0:1789479881.934174:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934183:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.934261:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799168:0@lo:256: 00000100:00100000:3.0:1789479881.934288:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.934305:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.934316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799168 00000100:00100000:3.0:1789479881.934319:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799168 00000100:00100000:3.0:1789479881.934338:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789479881.934344:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527799168:12345-0@lo:256: 20000000:01000000:3.0:1789479881.934355:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789479881.934372:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789479881.934375:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789479881.934442:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527799168:12345-0@lo:256: Request processed in 98us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.934449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789479881.934474:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799168:0@lo:256: 10000000:01000000:3.0:1789479881.934510:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789479881.934515:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934523:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479881.934535:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789479881.934536:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789479881.934551:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789479881.934564:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934572:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934712:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.934724:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799296:0@lo:101: 00000100:00100000:3.0:1789479881.934747:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.934759:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.934769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799296 00000100:00100000:3.0:1789479881.934773:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799296 00000100:00100000:3.0:1789479881.934790:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789479881.934795:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527799296:12345-0@lo:101: 00010000:00010000:3.0:1789479881.934802:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479881.934809:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d082 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934822:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d082 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934831:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d082 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934848:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6400, rc 0) 00000100:00100000:3.0:1789479881.934872:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527799296:12345-0@lo:101: Request processed in 77us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.934878:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789479881.934903:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799296:0@lo:101: 00010000:00010000:3.0:1789479881.934913:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479881.934921:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479881.934962:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799424:0@lo:501: 00000100:00100000:3.0:1789479881.934981:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.934991:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.935000:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799424 00000100:00100000:3.0:1789479881.935003:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799424 00000100:00100000:3.0:1789479881.935020:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789479881.935025:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527799424:12345-0@lo:501: 00000100:00100000:3.0:1789479881.935115:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527799424:12345-0@lo:501: Request processed in 89us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.935121:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789479881.935148:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799424:0@lo:501: 00000100:00100000:3.0:1789479881.935172:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799552:0@lo:503: 00000100:00100000:3.0:1789479881.935235:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.935254:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479881.935269:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799552 00000100:00100000:3.0:1789479881.935272:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799552 00000100:00100000:3.0:1789479881.935293:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789479881.935299:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527799552:12345-0@lo:503: 00000100:00100000:3.0:1789479881.935371:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527799552:12345-0@lo:503: Request processed in 72us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.935378:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789479881.935418:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527799552:0@lo:503: 00000100:00100000:3.0:1789479881.937268:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8488:1876405527799680:0@lo:502: 00000100:00100000:3.0:1789479881.937334:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.937414:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.938537:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8443:x1876405527798272:12345-0@lo:700: Request processed in 14451us (27909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479881.938550:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789479881.938602:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6a866f4000 x1876405527798272/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789479897 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479881.938615:0:8443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8443:1876405527798272:0@lo:700: 40000000:02000000:0.0:1789479881.938626:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:1.0:1789479881.946862:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799680 00000100:00100000:1.0:1789479881.946877:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799680 00000100:00100000:2.0:1789479881.950300:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789479881.950313:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:8488:x1876405527799680:12345-0@lo:502: 00000100:00100000:2.0:1789479881.950474:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:8488:x1876405527799680:12345-0@lo:502: Request processed in 164us (13139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.950482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789479881.951774:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8488:1876405527799680:0@lo:502: 00000020:01000000:3.0:1789479881.951814:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789479881.951822:0:8488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789479881.951830:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479881.951832:0:8488:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789479881.951838:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789479881.951842:0:8488:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1789479881.951864:0:8488:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789479881.951866:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789479881.951893:0:8488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a6ac1ac4d40) 00000020:00000080:3.0:1789479881.951916:0:8488:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789479881.951922:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789479881.952264:0:8488:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789479881.952270:0:8488:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789479881.952278:0:8488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243d097 00010000:00080000:3.0:1789479881.952307:0:8488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6abb67a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789479881.952530:0:8488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:0.0:1789479881.958793:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789479881.959103:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527798144:12345-0@lo:700: Request processed in 48542us (48661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.959120:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789479881.959697:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8a6a866f5500 x1876405527798144/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479897 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479881.959711:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527798144:0@lo:700: 00000040:01000000:1.0:1789479881.965993:0:8488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789479881.966017:0:8488:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789479881.966250:0:8488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479881.966566:0:8488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789479881.966651:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789479881.966733:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789479881.967550:0:8490:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789479881.967557:0:8490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789479881.974165:0:8488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789479881.974179:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789479881.974240:0:8488:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789479881.974262:0:8488:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243d09e 00000100:00080000:2.0:1789479881.974272:0:8488:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789479881.974282:0:8488:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a6abb67a800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789479881.974312:0:8488:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6abb504a80 x1876405527799808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789479881.974336:0:8488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789479881.974384:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479881.974387:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479881.974389:0:8488:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789479881.974392:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479881.974396:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479881.974397:0:8488:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789479881.974400:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789479881.974401:0:8488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789479881.974423:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8488:1876405527799936:0@lo:502: 00000100:00100000:2.0:1789479881.974486:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.974522:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.974565:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799936 00000100:00100000:2.0:1789479881.974571:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799936 00000100:00100000:2.0:1789479881.974948:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789479881.974956:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:8488:x1876405527799936:12345-0@lo:502: 00000100:00100000:2.0:1789479881.975878:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:8488:x1876405527799936:12345-0@lo:502: Request processed in 917us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.975888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789479881.975903:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:8488:1876405527799936:0@lo:502: 00000020:01000000:1.0:1789479881.975936:0:8488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479881.975941:0:8488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479881.975943:0:8488:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479881.975948:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789479881.976821:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789479881.976858:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789479881.976870:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.976881:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479881.976890:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789479881.976892:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a6a95c999c0 from 1 10000000:01000000:2.0:1789479881.976894:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789479881.976924:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.976931:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.976939:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.976956:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527800064:0@lo:101: 00000100:00100000:2.0:1789479881.977014:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.977044:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.977277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800064 00000100:00100000:2.0:1789479881.977284:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800064 00000100:00100000:2.0:1789479881.977325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789479881.977332:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527800064:12345-0@lo:101: 00010000:00010000:2.0:1789479881.977343:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479881.977355:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d0a5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.977376:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.977386:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.977394:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a600, rc 0) 00000100:00100000:2.0:1789479881.977427:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527800064:12345-0@lo:101: Request processed in 95us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479881.977433:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789479881.977460:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527800064:0@lo:101: 00010000:00010000:2.0:1789479881.977472:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.977480:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479881.977532:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527800192:0@lo:501: 00000100:00100000:2.0:1789479881.978338:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479881.978356:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.978378:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800192 00000100:00100000:2.0:1789479881.978383:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800192 00000100:00100000:2.0:1789479881.978418:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789479881.978426:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527800192:12345-0@lo:501: 00000100:00100000:2.0:1789479881.978502:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527800192:12345-0@lo:501: Request processed in 77us (166us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789479881.978508:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789479881.978901:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527799808:0@lo:8: 00000100:00100000:3.0:1789479881.978937:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.979046:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527799808 00000100:00100000:1.0:1789479881.979050:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527799808 00000100:00100000:2.0:1789479881.979308:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527800192:0@lo:501: 10000000:01000000:2.0:1789479881.979339:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789479881.979347:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479881.979357:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479881.984326:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479881.984338:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876405527799808:12345-0@lo:8: 00010000:00080000:1.0:1789479881.984373:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 250 last 0 00000020:00000080:1.0:1789479881.984402:0:8436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243d0b3 00002000:00100000:1.0:1789479881.984418:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a6abb5cc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789479881.984422:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789479881.984425:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789479881.984511:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789479881.984533:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479881.984615:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527799808:12345-0@lo:8: Request processed in 276us (5676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479881.984622:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789479881.984711:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8a6abb504a80 x1876405527799808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479881.984723:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479881.984731:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789479881.984738:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789479881.984743:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789479881.984755:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb67a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789479881.984776:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789479881.984782:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527799808:0@lo:8: 00000004:00080000:3.0:1789479881.987860:0:8486:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789479881.987894:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800448:0@lo:7: 00000100:00100000:3.0:1789479881.987950:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479881.988502:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00000100:00100000:0.0:1789479881.988831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527800320:0@lo:13: 00000100:00100000:0.0:1789479881.988871:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479881.988924:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800448 00000100:00100000:0.0:1789479881.988930:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800448 00000100:00100000:0.0:1789479881.988975:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479881.988984:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527800448:12345-0@lo:7: 00000100:00100000:3.0:1789479881.989258:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800320 00000100:00100000:3.0:1789479881.989262:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800320 00000100:00100000:3.0:1789479881.989285:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789479881.989291:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527800320:12345-0@lo:13: 00002000:00000024:3.0:1789479881.989306:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1789479881.989416:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527800320:12345-0@lo:13: Request processed in 123us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479881.989423:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1789479881.992407:0:8490:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789479881.992477:0:8490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 250916285916ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789479881.992483:0:8490:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789479881.995367:0:8492:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789479881.995396:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527800704:0@lo:7: 00000100:00100000:1.0:1789479881.995458:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479881.995488:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8856f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479881.995737:0:8436:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789479881.995745:0:8436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789479881.995869:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800704 00000100:00100000:2.0:1789479881.995875:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800704 00000100:00080000:2.0:1789479881.995922:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479881.996007:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789479881.996022:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8492:x1876405527800704:12345-0@lo:7: 00000004:00080000:2.0:1789479882.000305:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:2.0:1789479882.002371:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8a6a866f9c00 x1876405527800320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479882.002400:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527800320:0@lo:13: 00000100:00100000:2.0:1789479882.002433:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479882.002445:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527800576:0@lo:13: 00000100:00100000:2.0:1789479882.002510:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479882.002593:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800576 00000100:00100000:2.0:1789479882.002601:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800576 00000100:00100000:2.0:1789479882.002638:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789479882.002647:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876405527800576:12345-0@lo:13: 00002000:00000024:2.0:1789479882.002669:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:2.0:1789479882.002713:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876405527800576:12345-0@lo:13: Request processed in 68us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.002720:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789479882.002760:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbe300 x1876405527800576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479882.002776:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527800576:0@lo:13: 00010000:00010000:1.0:1789479882.009593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789479882.009626:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789479882.009633:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789479882.009719:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527800448:12345-0@lo:7: Request processed in 20733us (21765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479882.009730:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789479882.010902:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866fb800 x1876405527800448/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479897 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.010919:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800448:0@lo:7: 00000004:00080000:3.0:1789479882.010939:0:8486:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789479882.010985:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800832:0@lo:5: 00000100:00100000:3.0:1789479882.011961:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.012035:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800832 00000100:00100000:3.0:1789479882.012042:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800832 00000100:00100000:3.0:1789479882.012094:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479882.012103:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527800832:12345-0@lo:5: 00002000:00080000:3.0:1789479882.012129:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1789479882.012175:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527800832:12345-0@lo:5: Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.012182:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479882.012244:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00010000:00080000:3.0:1789479882.012263:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866fb800 x1876405527800832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.012274:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800832:0@lo:5: 00000004:00080000:3.0:1789479882.012286:0:8486:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789479882.012320:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800960:0@lo:5: 00000100:00100000:3.0:1789479882.012349:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.012375:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527800960 00000100:00100000:3.0:1789479882.012379:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527800960 00000100:00100000:3.0:1789479882.012404:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479882.012411:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8486:x1876405527800960:12345-0@lo:5: 00002000:00080000:3.0:1789479882.012434:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789479882.018325:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789479882.031822:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8486:x1876405527800960:12345-0@lo:5: Request processed in 19401us (19462us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789479882.031838:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789479882.031990:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866fb800 x1876405527800960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.032016:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8486:1876405527800960:0@lo:5: 00000004:00080000:3.0:1789479882.032030:0:8486:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789479882.032078:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8486:1876405527801088:0@lo:900: 00000100:00100000:3.0:1789479882.032110:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.032160:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801088 00000100:00100000:3.0:1789479882.032166:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801088 00000100:00100000:3.0:1789479882.032239:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479882.032248:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8486:x1876405527801088:12345-0@lo:900: 00000100:00100000:3.0:1789479882.032289:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8486:x1876405527801088:12345-0@lo:900: Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479882.032296:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479882.032323:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00010000:00080000:3.0:1789479882.032336:0:8486:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f9500 x1876405527801088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.036953:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8486:1876405527801088:0@lo:900: 00002000:00080000:2.0:1789479882.040685:0:8493:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789479882.040694:0:8493:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789479882.040778:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8492:x1876405527800704:12345-0@lo:7: Request processed in 44755us (45315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479882.040788:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789479882.040924:0:8492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbea00 x1876405527800704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479897 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.040939:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527800704:0@lo:7: 00000004:00080000:3.0:1789479882.040951:0:8492:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789479882.040986:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801216:0@lo:5: 00000100:00100000:3.0:1789479882.041024:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.041069:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00000100:00100000:2.0:1789479882.041465:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801216 00000100:00100000:2.0:1789479882.041472:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801216 00000100:00100000:2.0:1789479882.041511:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789479882.041518:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8492:x1876405527801216:12345-0@lo:5: 00002000:00080000:2.0:1789479882.041714:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789479882.041718:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789479882.068509:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1789479882.068534:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789479882.068550:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789479882.068775:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8492:x1876405527801216:12345-0@lo:5: Request processed in 27252us (27745us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789479882.068785:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789479882.069003:0:8492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f9500 x1876405527801216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.069015:0:8492:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789479882.069022:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801216:0@lo:5: 00000004:00080000:3.0:1789479882.069037:0:8492:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789479882.069085:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801344:0@lo:700: 00000100:00100000:3.0:1789479882.069115:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.069185:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789479882.075020:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801344 00000100:00100000:1.0:1789479882.075043:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801344 00000100:00100000:1.0:1789479882.075120:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789479882.075130:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8492:x1876405527801344:12345-0@lo:700: 00000100:00100000:0.0:1789479882.091394:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8492:x1876405527801344:12345-0@lo:700: Request processed in 16257us (22268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479882.091416:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789479882.091753:0:8492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f9500 x1876405527801344/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.091769:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801344:0@lo:700: 00000004:02000040:3.0:1789479882.094833:0:8492:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1789479882.109314:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801472:0@lo:5: 00000100:00100000:3.0:1789479882.110487:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479882.110529:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801472 00000100:00100000:3.0:1789479882.110545:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801472 00000100:00100000:3.0:1789479882.112269:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789479882.112290:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8492:x1876405527801472:12345-0@lo:5: 00000100:00100000:0.0:1789479882.114081:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9300 going to sleep for 11 seconds 00002000:00080000:3.0:1789479882.134239:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789479882.134267:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789479882.148563:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8492:x1876405527801472:12345-0@lo:5: Request processed in 36272us (38066us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789479882.148580:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789479882.160156:0:8492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f9500 x1876405527801472/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479898 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479882.160177:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8492:1876405527801472:0@lo:5: 00000004:00080000:3.0:1789479882.160234:0:8492:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1789479882.440051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479882.440077:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527801600:0@lo:41: 00000100:00100000:1.0:1789479882.440151:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479882.440238:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801600 00000100:00100000:1.0:1789479882.440245:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801600 00000100:00100000:1.0:1789479882.440282:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789479882.440289:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527801600:12345-0@lo:41: 00000004:00000024:1.0:1789479882.440320:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789479882.440695:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527801600:12345-0@lo:41: Request processed in 404us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479882.440702:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789479882.440769:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527801600:0@lo:41: 00000020:00000004:0.0:1789479882.572350:0:8521:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789479882.572577:0:8521:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789479883.012323:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479884.043903:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479884.489685:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479884.489713:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527801728:0@lo:41: 00000100:00100000:2.0:1789479884.489767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479884.489998:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801728 00000100:00100000:3.0:1789479884.490006:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801728 00000100:00100000:3.0:1789479884.490056:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479884.490065:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527801728:12345-0@lo:41: 00000004:00000024:3.0:1789479884.490096:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789479884.490139:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527801728:12345-0@lo:41: Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479884.490146:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479884.490525:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527801728:0@lo:41: 00010000:00010000:3.0:1789479885.062890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479886.085372:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479887.044363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527801856:0@lo:13: 00000100:00100000:2.0:1789479887.044425:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479887.044497:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801856 00000100:00100000:2.0:1789479887.044504:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801856 00000100:00100000:2.0:1789479887.044565:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479887.044576:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527801856:12345-0@lo:13: 00002000:00000024:2.0:1789479887.044603:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479887.044646:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527801856:12345-0@lo:13: Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479887.044662:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789479887.044682:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479887.044710:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb506d80 x1876405527801856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479887.044720:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789479887.044739:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527801856:0@lo:13: 00000100:00100000:0.0:1789479887.044949:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527802112:0@lo:400: 00000100:00100000:0.0:1789479887.044979:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479887.045000:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527802624:0@lo:400: 00000100:00100000:0.0:1789479887.045020:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479887.045039:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789479887.045045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527802240:0@lo:400: 00000100:00100000:0.0:1789479887.045066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479887.045081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527802752:0@lo:400: 00000100:00100000:0.0:1789479887.045103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479887.045125:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802112 00000100:00100000:0.0:1789479887.045130:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802112 00000100:00100000:0.0:1789479887.045150:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802624 00000100:00100000:0.0:1789479887.045152:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802624 00000100:00100000:0.0:1789479887.045172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802752 00000100:00100000:0.0:1789479887.045175:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802752 00000100:00100000:0.0:1789479887.045220:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789479887.045227:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527802112:12345-0@lo:400: 00000100:00100000:0.0:1789479887.045261:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527802112:12345-0@lo:400: Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479887.045267:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789479887.045277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479887.045282:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527802624:12345-0@lo:400: 00000100:00100000:0.0:1789479887.045311:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527802624:12345-0@lo:400: Request processed in 29us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479887.045316:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479887.045325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479887.045330:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527802752:12345-0@lo:400: 00000100:00100000:0.0:1789479887.045348:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527802752:12345-0@lo:400: Request processed in 18us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479887.045353:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1789479887.045366:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479887.045368:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789479887.045381:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f5c00 x1876405527802752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479887.045391:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527802752:0@lo:400: 00010000:00080000:0.0:1789479887.045399:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f4a80 x1876405527802112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479887.045407:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527802112:0@lo:400: 00010000:00080000:0.0:1789479887.045414:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f6680 x1876405527802624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479887.045421:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527802624:0@lo:400: 00000100:00100000:1.0:1789479887.045684:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527801984:0@lo:400: 00000100:00100000:1.0:1789479887.045716:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.045751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527802496:0@lo:400: 00000100:00100000:1.0:1789479887.045772:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.045791:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527803008:0@lo:13: 00000100:00100000:1.0:1789479887.045810:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.045833:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789479887.045839:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527802368:0@lo:400: 00000100:00100000:1.0:1789479887.045856:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.045879:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527802880:0@lo:400: 00000100:00100000:1.0:1789479887.045895:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.045919:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802240 00000100:00100000:1.0:1789479887.045923:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802240 00000100:00100000:1.0:1789479887.045945:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802496 00000100:00100000:1.0:1789479887.045947:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802496 00000100:00100000:1.0:1789479887.045957:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789479887.045962:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527802240:12345-0@lo:400: 00000100:00100000:1.0:1789479887.045993:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527802240:12345-0@lo:400: Request processed in 31us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.045999:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789479887.046012:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479887.046017:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527802496:12345-0@lo:400: 00000100:00100000:1.0:1789479887.046046:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527802496:12345-0@lo:400: Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.046052:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479887.046069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802368 00000100:00100000:1.0:1789479887.046072:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802368 00000100:00100000:1.0:1789479887.046089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479887.046094:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527802368:12345-0@lo:400: 00000100:00100000:1.0:1789479887.046135:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527802368:12345-0@lo:400: Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.046140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789479887.046160:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527802880 00000100:00100000:1.0:1789479887.046163:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527802880 00000100:00100000:1.0:1789479887.046217:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479887.046223:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527802880:12345-0@lo:400: 00000100:00100000:1.0:1789479887.046271:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527802880:12345-0@lo:400: Request processed in 48us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.046280:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789479887.046303:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803008 00000100:00100000:1.0:1789479887.046306:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803008 00000100:00100000:1.0:1789479887.046322:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789479887.046327:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527803008:12345-0@lo:13: 00002000:00000024:1.0:1789479887.046338:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479887.046360:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527803008:12345-0@lo:13: Request processed in 34us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.046365:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789479887.046388:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a866f6d80 x1876405527802368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479887.046398:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527802368:0@lo:400: 00010000:00080000:1.0:1789479887.046406:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6986a1f480 x1876405527802880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479887.046414:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527802880:0@lo:400: 00000100:00100000:1.0:1789479887.046421:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527802496:0@lo:400: 00010000:00080000:1.0:1789479887.046428:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbd500 x1876405527803008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479887.046437:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527803008:0@lo:13: 00000100:00100000:1.0:1789479887.046461:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527802240:0@lo:400: 00000100:00100000:0.0:1789479887.046721:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527801984 00000100:00100000:0.0:1789479887.046726:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527801984 00000100:00100000:0.0:1789479887.046761:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789479887.046768:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527801984:12345-0@lo:400: 00000100:00100000:0.0:1789479887.046801:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527801984:12345-0@lo:400: Request processed in 35us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479887.046816:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1789479887.046843:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479887.050771:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527801984:0@lo:400: 00010000:00010000:3.0:1789479887.108568:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479887.561848:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479887.561873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527803136:0@lo:41: 00000100:00100000:1.0:1789479887.561942:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479887.562002:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803136 00000100:00100000:1.0:1789479887.562010:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803136 00000100:00100000:1.0:1789479887.562052:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789479887.562061:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527803136:12345-0@lo:41: 00000004:00000024:1.0:1789479887.562089:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789479887.562143:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527803136:12345-0@lo:41: Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479887.562317:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789479887.562360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527803136:0@lo:41: 00000001:00080000:0.0:1789479888.076119:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1789479888.136513:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479889.160349:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789479889.572398:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789479889.607452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527803264:0@lo:41: 00000100:00100000:1.0:1789479889.607514:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479889.607679:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803264 00000100:00100000:3.0:1789479889.607738:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803264 00000100:00100000:3.0:1789479889.607788:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479889.607797:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527803264:12345-0@lo:41: 00000004:00000024:3.0:1789479889.607946:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789479889.607995:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527803264:12345-0@lo:41: Request processed in 198us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479889.608003:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479889.608047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527803264:0@lo:41: 00010000:00010000:0.0:1789479890.184636:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789479890.743406:0:8863:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789479890.744821:0:8863:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789479891.209983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479892.164467:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527803392:0@lo:13: 00000100:00100000:0.0:1789479892.164527:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527803520:0@lo:13: 00000100:00100000:3.0:1789479892.164595:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479892.164660:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527803648:0@lo:400: 00000100:00100000:0.0:1789479892.164706:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479892.164724:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527803904:0@lo:400: 00000100:00100000:0.0:1789479892.164764:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479892.164771:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479892.164780:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527803776:0@lo:400: 00000100:00100000:0.0:1789479892.164823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479892.164834:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803904 00000100:00100000:3.0:1789479892.164845:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803904 00000100:00100000:0.0:1789479892.164871:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479892.164915:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789479892.164926:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527803904:12345-0@lo:400: 00000100:00100000:3.0:1789479892.164997:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527803904:12345-0@lo:400: Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479892.165005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789479892.165060:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527803904:0@lo:400: 00000100:00100000:3.0:1789479892.165104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803648 00000100:00100000:3.0:1789479892.165108:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803648 00000100:00100000:3.0:1789479892.165137:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789479892.165144:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:3647:x1876405527803648:12345-0@lo:400: 00000100:00100000:3.0:1789479892.165227:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:3647:x1876405527803648:12345-0@lo:400: Request processed in 83us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479892.165234:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789479892.165277:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803392 00000100:00100000:3.0:1789479892.165281:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803392 00000100:00100000:3.0:1789479892.165310:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803520 00000100:00100000:3.0:1789479892.165313:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803520 00000100:00100000:3.0:1789479892.165327:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479892.165333:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527803392:12345-0@lo:13: 00002000:00000024:3.0:1789479892.165358:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479892.165392:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527803392:12345-0@lo:13: Request processed in 60us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479892.165398:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789479892.165418:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789479892.165424:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527803520:12345-0@lo:13: 00002000:00000024:3.0:1789479892.165434:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479892.178257:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527803776 00000100:00100000:1.0:1789479892.178273:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527803776 00000100:00100000:1.0:1789479892.178339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789479892.178351:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527803776:12345-0@lo:400: 00000100:00100000:1.0:1789479892.178440:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527803776:12345-0@lo:400: Request processed in 92us (13618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479892.178446:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789479892.178610:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb507480 x1876405527803776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479892.178625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527803776:0@lo:400: 00000100:00100000:1.0:1789479892.178637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527803648:0@lo:400: 00000100:00080000:1.0:1789479892.178674:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789479892.178703:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbc700 x1876405527803392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479892.178731:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789479892.178749:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527803392:0@lo:13: 00000100:00100000:3.0:1789479892.182799:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527803520:12345-0@lo:13: Request processed in 17360us (17914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479892.182818:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789479892.187148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb506d80 x1876405527803520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479892.187202:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527803520:0@lo:13: 00000100:00100000:1.0:1789479892.189600:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479892.189640:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527804032:0@lo:400: 00000100:00100000:1.0:1789479892.189711:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479892.189785:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479892.189795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804160:0@lo:400: 00000100:00100000:1.0:1789479892.189824:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479892.189859:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804160 00000100:00100000:1.0:1789479892.189866:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804160 00000100:00100000:1.0:1789479892.189910:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479892.189919:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804160:12345-0@lo:400: 00000100:00100000:1.0:1789479892.189995:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804160:12345-0@lo:400: Request processed in 76us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479892.190008:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789479892.190050:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527804288:0@lo:400: 00000100:00100000:1.0:1789479892.190084:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479892.190130:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804160:0@lo:400: 00000100:00100000:1.0:1789479892.190170:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527804416:0@lo:400: 00000100:00100000:1.0:1789479892.190219:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479892.190248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804032 00000100:00100000:1.0:1789479892.190265:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804032 00000100:00100000:1.0:1789479892.190285:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804288 00000100:00100000:1.0:1789479892.190287:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804288 00000100:00100000:1.0:1789479892.190311:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804416 00000100:00100000:1.0:1789479892.190315:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804416 00000100:00100000:2.0:1789479892.190343:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479892.190363:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527804032:12345-0@lo:400: 00000100:00100000:2.0:1789479892.190463:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527804032:12345-0@lo:400: Request processed in 107us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479892.190483:0:6522:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00010000:00080000:3.0:1789479892.190501:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb504e00 x1876405527804032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479892.190503:0:6522:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789479892.190521:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527804032:0@lo:400: 00000100:00080000:0.0:1789479892.190665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479892.190672:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479892.190819:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789479892.190830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479892.190841:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527804288:12345-0@lo:400: 00000100:00100000:1.0:1789479892.190899:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527804288:12345-0@lo:400: Request processed in 62us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479892.190906:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479892.190930:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789479892.190936:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479892.190942:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527804416:12345-0@lo:400: 00000100:00100000:1.0:1789479892.191108:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527804416:12345-0@lo:400: Request processed in 166us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479892.191115:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789479892.191164:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb505180 x1876405527804288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479892.191175:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527804288:0@lo:400: 00010000:00080000:3.0:1789479892.195681:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb505500 x1876405527804416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479892.195706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527804416:0@lo:400: 00000100:00100000:2.0:1789479892.196928:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1789479892.230893:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479892.681334:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479892.681361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527804544:0@lo:41: 00000100:00100000:1.0:1789479892.681440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479892.684000:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804544 00000100:00100000:3.0:1789479892.684014:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804544 00000100:00100000:3.0:1789479892.684081:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479892.684091:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527804544:12345-0@lo:41: 00000004:00000024:3.0:1789479892.684126:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789479892.684255:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527804544:12345-0@lo:41: Request processed in 165us (2814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479892.684262:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789479892.684370:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527804544:0@lo:41: 00010000:00010000:3.0:1789479893.288054:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789479894.284555:0:8965:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789479894.284741:0:8965:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789479894.343398:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479894.725738:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479894.725760:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804672:0@lo:41: 00000100:00100000:1.0:1789479894.725820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479894.726021:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804672 00000100:00100000:3.0:1789479894.726029:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804672 00000100:00100000:3.0:1789479894.726070:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479894.726080:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804672:12345-0@lo:41: 00000004:00000024:3.0:1789479894.726109:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789479894.726177:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804672:12345-0@lo:41: Request processed in 98us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479894.726184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479894.726246:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804672:0@lo:41: 00010000:00010000:2.0:1789479895.365888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789479895.492803:0:9014:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789479895.492813:0:9014:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1789479896.401166:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479897.285845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804800:0@lo:13: 00000100:00100000:3.0:1789479897.285911:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479897.286009:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804800 00000100:00100000:1.0:1789479897.286016:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804800 00000100:00100000:1.0:1789479897.286073:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479897.286081:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804800:12345-0@lo:13: 00002000:00000024:1.0:1789479897.286105:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479897.286162:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527804800:12345-0@lo:13: Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479897.286167:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789479897.286248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789479897.286277:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbe680 x1876405527804800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.286293:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527804800:0@lo:13: 00000100:00100000:3.0:1789479897.290693:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527805056:0@lo:400: 00000100:00100000:3.0:1789479897.290750:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290788:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527805568:0@lo:400: 00000100:00100000:3.0:1789479897.290804:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290825:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789479897.290830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527804928:0@lo:400: 00000100:00100000:3.0:1789479897.290850:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290870:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527805440:0@lo:400: 00000100:00100000:3.0:1789479897.290886:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290906:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527805184:0@lo:400: 00000100:00100000:3.0:1789479897.290922:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290934:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527805696:0@lo:400: 00000100:00100000:3.0:1789479897.290948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.290959:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789479897.290963:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527805312:0@lo:400: 00000100:00100000:3.0:1789479897.290988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.291002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527805824:0@lo:400: 00000100:00100000:3.0:1789479897.291017:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479897.291039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805056 00000100:00100000:3.0:1789479897.291045:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805056 00000100:00100000:3.0:1789479897.291087:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805568 00000100:00100000:3.0:1789479897.291089:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805568 00000100:00100000:3.0:1789479897.291107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805696 00000100:00100000:3.0:1789479897.291109:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805696 00000100:00100000:3.0:1789479897.291119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805312 00000100:00100000:3.0:1789479897.291120:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805312 00000100:00100000:3.0:1789479897.291144:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789479897.291151:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527805056:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291219:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527805056:12345-0@lo:400: Request processed in 68us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291225:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789479897.291239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479897.291244:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527805568:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291266:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527805568:12345-0@lo:400: Request processed in 22us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291271:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479897.291280:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479897.291285:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527805696:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291310:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527805696:12345-0@lo:400: Request processed in 25us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291315:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789479897.291324:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789479897.291329:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527805312:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291361:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527805312:12345-0@lo:400: Request processed in 32us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291366:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789479897.291381:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805440 00000100:00100000:3.0:1789479897.291384:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805440 00000100:00100000:3.0:1789479897.291401:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805184 00000100:00100000:3.0:1789479897.291403:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805184 00000100:00100000:3.0:1789479897.291411:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479897.291416:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527805440:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291441:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527805440:12345-0@lo:400: Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291446:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479897.291458:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479897.291463:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527805184:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291484:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527805184:12345-0@lo:400: Request processed in 21us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291489:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479897.291511:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805824 00000100:00100000:3.0:1789479897.291514:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805824 00000100:00100000:3.0:1789479897.291538:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789479897.291543:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527805824:12345-0@lo:400: 00000100:00100000:3.0:1789479897.291569:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527805824:12345-0@lo:400: Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479897.291574:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789479897.291587:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479897.291591:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479897.291593:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789479897.291622:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbca80 x1876405527805312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.291642:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527805312:0@lo:400: 00010000:00080000:3.0:1789479897.291654:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b3b80 x1876405527805824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.291662:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527805824:0@lo:400: 00000100:00100000:3.0:1789479897.291670:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527805184:0@lo:400: 00010000:00080000:3.0:1789479897.291678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b0e00 x1876405527805696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.291686:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527805696:0@lo:400: 00000100:00100000:3.0:1789479897.291717:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527805440:0@lo:400: 00010000:00080000:3.0:1789479897.291726:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbf800 x1876405527805056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.291732:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527805056:0@lo:400: 00010000:00080000:3.0:1789479897.291741:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b1f80 x1876405527805568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479897.291748:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527805568:0@lo:400: 00000100:00100000:1.0:1789479897.291878:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527804928 00000100:00100000:1.0:1789479897.291883:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527804928 00000100:00100000:1.0:1789479897.291919:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789479897.291926:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527804928:12345-0@lo:400: 00000100:00100000:1.0:1789479897.291961:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527804928:12345-0@lo:400: Request processed in 36us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479897.291967:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789479897.297512:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527804928:0@lo:400: 00000100:00100000:2.0:1789479897.298416:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527805952:0@lo:13: 00000100:00100000:2.0:1789479897.298472:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479897.298515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527805952 00000100:00100000:2.0:1789479897.298521:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527805952 00000100:00100000:2.0:1789479897.298558:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789479897.298566:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527805952:12345-0@lo:13: 00002000:00000024:2.0:1789479897.298585:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479897.298624:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527805952:12345-0@lo:13: Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479897.298631:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789479897.298665:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb505500 x1876405527805952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479897.298680:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527805952:0@lo:13: 00010000:00010000:2.0:1789479897.412439:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479897.797431:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527806080:0@lo:41: 00000100:00100000:2.0:1789479897.797490:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479897.798936:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806080 00000100:00100000:0.0:1789479897.798947:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806080 00000100:00100000:0.0:1789479897.798999:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789479897.799008:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527806080:12345-0@lo:41: 00000004:00000024:0.0:1789479897.799039:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789479897.799101:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527806080:12345-0@lo:41: Request processed in 95us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479897.799107:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789479897.799158:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527806080:0@lo:41: 00010000:00010000:0.0:1789479898.448237:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479899.461963:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479899.844430:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479899.844454:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527806208:0@lo:41: 00000100:00100000:2.0:1789479899.844526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479899.844762:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806208 00000100:00100000:1.0:1789479899.844769:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806208 00000100:00100000:1.0:1789479899.844818:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789479899.844827:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527806208:12345-0@lo:41: 00000004:00000024:1.0:1789479899.844857:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789479899.844915:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527806208:12345-0@lo:41: Request processed in 89us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479899.844921:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789479899.844994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527806208:0@lo:41: 00010000:00010000:0.0:1789479900.485360:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479901.508386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479902.406670:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527806336:0@lo:13: 00000100:00100000:2.0:1789479902.406737:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.406882:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806336 00000100:00100000:3.0:1789479902.406891:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806336 00000100:00100000:3.0:1789479902.406962:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789479902.406966:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479902.406973:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527806336:12345-0@lo:13: 00002000:00000024:3.0:1789479902.407024:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479902.407300:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527806336:12345-0@lo:13: Request processed in 329us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479902.407308:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789479902.407465:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479902.407475:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527806464:0@lo:13: 00000100:00100000:1.0:1789479902.407509:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479902.407597:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806464 00000100:00100000:0.0:1789479902.407604:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806464 00000100:00100000:0.0:1789479902.407653:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789479902.407661:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527806464:12345-0@lo:13: 00002000:00000024:0.0:1789479902.407676:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479902.407687:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527806976:0@lo:400: 00000100:00100000:0.0:1789479902.407714:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527806464:12345-0@lo:13: Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479902.407721:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789479902.407727:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.407750:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789479902.407755:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527806592:0@lo:400: 00000100:00100000:3.0:1789479902.407778:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.407806:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527807104:0@lo:400: 00000100:00100000:3.0:1789479902.407825:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.407848:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806976 00000100:00100000:3.0:1789479902.407851:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806976 00010000:00080000:1.0:1789479902.408148:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b3480 x1876405527806464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479902.408167:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527806464:0@lo:13: 00000100:00100000:3.0:1789479902.408394:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789479902.408402:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527806976:12345-0@lo:400: 00000100:00100000:3.0:1789479902.408444:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527806976:12345-0@lo:400: Request processed in 43us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479902.408450:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789479902.408469:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807104 00000100:00100000:3.0:1789479902.408472:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807104 00000100:00100000:3.0:1789479902.408493:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789479902.408499:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527807104:12345-0@lo:400: 00000100:00100000:3.0:1789479902.408527:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527807104:12345-0@lo:400: Request processed in 28us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479902.408532:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789479902.408551:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527806720:0@lo:400: 00000100:00100000:3.0:1789479902.408780:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.408843:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527807232:0@lo:400: 00000100:00100000:0.0:1789479902.408899:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806592 00000100:00100000:0.0:1789479902.408904:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806592 00000100:00100000:0.0:1789479902.408936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789479902.408943:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:3645:x1876405527806592:12345-0@lo:400: 00000100:00100000:3.0:1789479902.408951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479902.408991:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:3645:x1876405527806592:12345-0@lo:400: Request processed in 48us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479902.409003:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789479902.409031:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789479902.409040:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527806848:0@lo:400: 00000100:00100000:3.0:1789479902.409077:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.409110:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527807360:0@lo:400: 00000100:00100000:3.0:1789479902.409130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479902.409167:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806848 00000100:00100000:0.0:1789479902.409172:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806848 00000100:00100000:0.0:1789479902.409213:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789479902.409227:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527806848:12345-0@lo:400: 00000100:00100000:1.0:1789479902.409232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527806720 00000100:00100000:1.0:1789479902.409238:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527806720 00000100:00100000:0.0:1789479902.409268:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527806848:12345-0@lo:400: Request processed in 41us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479902.409269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807232 00000100:00100000:0.0:1789479902.409275:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479902.409279:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807232 00000100:00100000:1.0:1789479902.409307:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789479902.409314:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527806720:12345-0@lo:400: 00000100:00100000:0.0:1789479902.409325:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789479902.409335:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527807232:12345-0@lo:400: 00000100:00100000:1.0:1789479902.409351:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527806720:12345-0@lo:400: Request processed in 37us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479902.409358:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789479902.409374:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527807232:12345-0@lo:400: Request processed in 40us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479902.409380:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789479902.409553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb02f100 x1876405527806720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479902.409582:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527806720:0@lo:400: 00000100:00100000:0.0:1789479902.409582:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527806592:0@lo:400: 00010000:00080000:3.0:1789479902.409600:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb02d180 x1876405527807232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479902.409604:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527807104:0@lo:400: 00000100:00100000:3.0:1789479902.409617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527807232:0@lo:400: 00010000:00080000:0.0:1789479902.409624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb02ea00 x1876405527806976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479902.409635:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527806976:0@lo:400: 00000100:00100000:3.0:1789479902.409640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527806848:0@lo:400: 00000100:00100000:1.0:1789479902.409753:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807360 00000100:00100000:1.0:1789479902.409757:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807360 00000100:00100000:0.0:1789479902.409867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789479902.409874:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527807360:12345-0@lo:400: 00000100:00100000:0.0:1789479902.409912:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527807360:12345-0@lo:400: Request processed in 39us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479902.409918:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789479902.410021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6985dbed80 x1876405527807360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479902.410032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527807360:0@lo:400: 00000100:00080000:3.0:1789479902.410058:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479902.410062:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479902.410065:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479902.411000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb02c000 x1876405527806336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479902.411037:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527806336:0@lo:13: 00010000:00010000:2.0:1789479902.532318:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479902.917700:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479902.917728:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527807488:0@lo:41: 00000100:00100000:1.0:1789479902.917791:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479902.917859:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807488 00000100:00100000:3.0:1789479902.917867:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807488 00000100:00100000:3.0:1789479902.917916:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789479902.917925:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527807488:12345-0@lo:41: 00000004:00000024:3.0:1789479902.917968:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789479902.918010:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527807488:12345-0@lo:41: Request processed in 86us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479902.918016:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479902.918701:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527807488:0@lo:41: 00010000:00010000:2.0:1789479903.567084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479904.580941:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479904.965130:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479904.965156:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527807616:0@lo:41: 00000100:00100000:0.0:1789479904.965248:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479904.965358:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807616 00000100:00100000:1.0:1789479904.965366:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807616 00000100:00100000:1.0:1789479904.965418:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479904.965427:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527807616:12345-0@lo:41: 00000004:00000024:1.0:1789479904.965470:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789479904.965516:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527807616:12345-0@lo:41: Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479904.965523:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789479904.965799:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527807616:0@lo:41: 00010000:00010000:2.0:1789479905.606301:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479906.629294:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789479907.226580:0:9513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789479907.226583:0:9513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789479907.226585:0:9513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789479907.226715:0:9513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a6abb3b8800 00000020:01000004:3.0:1789479907.226730:0:9513:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789479907.226741:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789479907.226753:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a6ac1ac3380) 00000020:00000080:3.0:1789479907.226770:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789479907.333744:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789479907.333795:0:9513:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789479907.368675:0:9513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789479907.368895:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789479907.368907:0:9513:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789479907.368918:0:9513:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdaa289fda243d0c1 00000020:01000004:2.0:1789479907.368925:0:9513:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789479907.368943:0:9513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789479907.368947:0:9513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789479907.368953:0:9513:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789479907.368977:0:9513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789479907.368980:0:9513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789479907.424285:0:9513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789479907.425262:0:9513:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789479907.425267:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789479907.425269:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789479907.425270:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479907.425271:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479907.425272:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479907.425274:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479907.425275:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479907.425276:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479907.425278:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479907.425279:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479907.425280:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479907.425284:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789479907.425286:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789479907.425288:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789479907.425289:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789479907.425297:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789479907.425298:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789479907.425299:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789479907.425300:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789479907.425301:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789479907.425302:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789479907.425303:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789479907.425304:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789479907.425331:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789479907.425349:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527807744:0@lo:253: 00000100:00100000:2.0:1789479907.425414:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479907.425483:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417540 going to sleep for 11 seconds 00000100:00100000:3.0:1789479907.425544:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807744 00000100:00100000:3.0:1789479907.425552:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807744 00000100:00100000:3.0:1789479907.425614:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789479907.425623:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:9513:x1876405527807744:12345-0@lo:253: 20000000:01000000:3.0:1789479907.425649:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789479907.425653:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789479907.425658:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789479907.425661:0:6512:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789479907.425893:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479907.426468:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1789479907.426561:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789479907.426585:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1789479907.426662:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789479907.426684:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1789479907.426703:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1789479907.426797:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1789479907.426812:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:2.0:1789479907.426814:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789479907.426834:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1789479907.426840:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479907.426854:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1789479907.426859:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1789479907.426873:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1789479907.426880:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789479907.426911:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1789479907.426929:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1789479907.426999:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1789479907.427010:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:2.0:1789479907.427011:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789479907.427026:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1789479907.427040:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789479907.427057:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1789479907.427062:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1789479907.427090:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1789479907.427098:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789479907.427114:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1789479907.427131:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1789479907.427539:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1789479907.427552:0:6512:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.144@tcp 20000000:01000000:2.0:1789479907.427554:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.144@tcp (null) (null) (null) 00000040:00080000:2.0:1789479907.427570:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1789479907.427576:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789479907.427591:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1789479907.427797:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.144@tcp (null) (null) 00000040:00080000:2.0:1789479907.427818:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1789479907.427825:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789479907.427840:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1789479907.427857:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1789479907.427871:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789479907.427874:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789479907.427877:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789479907.427935:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789479907.427938:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789479907.433980:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1789479907.434444:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1789479907.434489:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1789479907.434530:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1789479907.434543:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789479907.434546:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789479907.436284:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789479907.436320:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789479907.436338:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1789479907.436505:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1789479907.436527:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1789479907.436542:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1789479907.436551:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789479907.436560:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789479907.437361:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1789479907.437384:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1789479907.437411:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1789479907.437618:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1789479907.437642:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1789479907.437658:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1789479907.437668:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789479907.437670:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789479907.440641:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789479907.440692:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789479907.440705:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789479907.441124:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789479907.441148:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1789479907.441164:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1789479907.441174:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789479907.441176:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789479907.442925:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1789479907.442969:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1789479907.442988:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1789479907.443284:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1789479907.443318:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1789479907.443339:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1789479907.443356:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479907.443378:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443395:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443414:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443420:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d020 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443427:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443434:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d066 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.443440:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d082 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.444142:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.444165:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.444239:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.444253:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.445167:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527807872:0@lo:104: 00000100:00100000:1.0:1789479907.445499:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479907.445555:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.445575:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.445583:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808000:0@lo:104: 00000100:00100000:1.0:1789479907.445620:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479907.445647:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.445655:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 21 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.445664:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808128:0@lo:104: 00000100:00100000:1.0:1789479907.445685:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479907.445703:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.445710:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.445913:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527807872 00000100:00100000:0.0:1789479907.445920:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527807872 00000100:00100000:0.0:1789479907.445965:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808000 00000100:00100000:0.0:1789479907.445969:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808000 00000100:00100000:0.0:1789479907.445979:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808128 00000100:00100000:0.0:1789479907.445981:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808128 00000100:00100000:0.0:1789479907.445993:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479907.446000:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527807872:12345-0@lo:104: 00010000:00010000:0.0:1789479907.446012:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446066:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479907.446082:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527807872:12345-0@lo:104: Request processed in 72us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.446089:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479907.446113:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479907.446119:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527808000:12345-0@lo:104: 00010000:00010000:0.0:1789479907.446126:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446166:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789479907.446172:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527808000:12345-0@lo:104: Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.446177:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479907.446211:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789479907.446217:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527808128:12345-0@lo:104: 00010000:00010000:0.0:1789479907.446224:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446250:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789479907.446268:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527808128:12345-0@lo:104: Request processed in 51us (581us total) trans 0 rc 0/0 00010000:00010000:3.0:1789479907.446269:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1789479907.446278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789479907.446280:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446291:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.446295:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446307:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479907.446312:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.446321:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.446338:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.446367:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446374:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.446393:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446400:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047a400/0xdaa289fda243d0a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0ac expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446413:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479907.446417:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446423:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.446426:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446434:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.446440:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.446452:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.446468:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446474:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479907.446479:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.446482:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446486:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446491:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d066 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d06d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446499:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789479907.446504:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.446506:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.446510:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.446513:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479907.446516:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789479907.446524:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.446540:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527808384:0@lo:103: 10000000:01000000:0.0:1789479907.446540:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479907.446574:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.446582:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479907.446587:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789479907.446618:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.446619:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479907.446628:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527808512:0@lo:103: 00010000:00010000:0.0:1789479907.446629:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6c00/0xdaa289fda243d082 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d089 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.446643:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479907.446645:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479907.446647:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479907.446655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.446660:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527808640:0@lo:103: 00000100:00100000:0.0:1789479907.446695:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.447067:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808256:0@lo:104: 00000100:00100000:3.0:1789479907.447134:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808384 00000100:00100000:3.0:1789479907.447139:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808384 00000100:00100000:0.0:1789479907.447234:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808512 00000100:00100000:0.0:1789479907.447238:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808512 00010000:00010000:0.0:1789479907.447267:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.447284:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808640 00000100:00100000:0.0:1789479907.447287:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808640 00010000:00010000:0.0:1789479907.447299:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.447309:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.447315:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479907.447326:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527808512:12345-0@lo:103: 00010000:00010000:0.0:1789479907.447337:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479907.447348:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 24 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.447358:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 24 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.447372:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.447389:0:6506:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789479907.447397:0:6506:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789479907.447410:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527808512:12345-0@lo:103: Request processed in 85us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.447417:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479907.447435:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479907.447453:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3645:x1876405527808640:12345-0@lo:103: 00010000:00010000:0.0:1789479907.447462:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479907.447468:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.447473:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789479907.447483:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.447488:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+23:3647:x1876405527808384:12345-0@lo:103: 00010000:00010000:0.0:1789479907.447497:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789479907.447510:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789479907.447526:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3645:x1876405527808640:12345-0@lo:103: Request processed in 85us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.447533:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479907.447563:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527808640:0@lo:103: 00010000:00010000:3.0:1789479907.447571:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.447581:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479907.447584:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.447587:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 22 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.447599:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.447625:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+22:3647:x1876405527808384:12345-0@lo:103: Request processed in 142us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.447632:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789479907.447970:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527808512:0@lo:103: 00000100:00100000:2.0:1789479907.447978:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527808384:0@lo:103: 00000100:00100000:0.0:1789479907.448499:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479907.448549:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.448574:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 21 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.448584:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808768:0@lo:104: 00000100:00100000:0.0:1789479907.448621:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479907.448655:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.448664:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 21 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.448673:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808896:0@lo:104: 00000100:00100000:0.0:1789479907.448693:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479907.448707:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479907.448826:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789479907.448837:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808256 00000100:00100000:2.0:1789479907.448843:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808256 00000100:00100000:2.0:1789479907.448866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808768 00000100:00100000:2.0:1789479907.448868:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808768 00000100:00100000:2.0:1789479907.448877:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527808896 00000100:00100000:2.0:1789479907.448879:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527808896 00000100:00100000:2.0:1789479907.448890:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479907.448897:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527808256:12345-0@lo:104: 00010000:00010000:2.0:1789479907.448907:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.448958:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479907.448963:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:6512:x1876405527808256:12345-0@lo:104: Request processed in 68us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.448968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479907.448982:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479907.448995:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527808768:12345-0@lo:104: 00010000:00010000:2.0:1789479907.449003:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.449040:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789479907.449045:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:6512:x1876405527808768:12345-0@lo:104: Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.449050:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479907.449062:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789479907.449067:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527808896:12345-0@lo:104: 00010000:00010000:2.0:1789479907.449084:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.449125:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789479907.449130:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985d21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527808896:12345-0@lo:104: Request processed in 63us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.449135:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1789479907.449396:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789479907.449403:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449412:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.449416:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449424:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.449430:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.449435:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.449459:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449464:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.449486:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449492:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6a00/0xdaa289fda243d03c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d043 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449502:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479907.449505:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449510:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.449512:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449529:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.449534:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.449539:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.449551:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449556:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.449567:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449573:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7800/0xdaa289fda243d020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d027 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449581:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479907.449589:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449594:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.449597:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449603:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.449608:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.449613:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789479907.449623:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 21 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449628:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449637:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789479907.449640:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527809024:0@lo:104: 00010000:00010000:3.0:1789479907.449644:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.449652:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475000/0xdaa289fda243cfe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfe8 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.449653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.449664:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.449667:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.449670:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479907.449683:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527809152:0@lo:103: 00000100:00100000:0.0:1789479907.449688:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.449723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.449729:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479907.449792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809024 00000100:00100000:2.0:1789479907.449796:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809024 00000100:00100000:2.0:1789479907.449816:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789479907.449821:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527809024:12345-0@lo:104: 00010000:00010000:2.0:1789479907.449828:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.449862:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d0ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d0a5 expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.449874:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527807872:0@lo:104: 00000100:00100000:1.0:1789479907.450605:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809152 00000100:00100000:1.0:1789479907.450612:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809152 00010000:00010000:1.0:1789479907.450637:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.450665:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789479907.450673:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa24b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527809152:12345-0@lo:103: 00010000:00010000:1.0:1789479907.450682:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479907.450695:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.450704:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.450730:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.450821:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527809408:0@lo:103: 00000100:00100000:3.0:1789479907.450864:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.450883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479907.450890:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527809280:0@lo:103: 00000100:00100000:3.0:1789479907.450908:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.450936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809408 00000100:00100000:3.0:1789479907.450940:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809408 00010000:00010000:3.0:1789479907.450957:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.450970:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809280 00000100:00100000:3.0:1789479907.450972:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809280 00010000:00010000:3.0:1789479907.450983:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.450994:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789479907.451000:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3648:x1876405527809408:12345-0@lo:103: 00010000:00010000:3.0:1789479907.451007:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479907.451011:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.451019:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 23 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.451028:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.451053:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3648:x1876405527809408:12345-0@lo:103: Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.451059:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789479907.451085:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789479907.451092:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+22:3648:x1876405527809280:12345-0@lo:103: 00010000:00010000:3.0:1789479907.451109:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479907.451113:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.451121:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 22 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.451130:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.451482:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+22:3648:x1876405527809280:12345-0@lo:103: Request processed in 389us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.451489:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789479907.451598:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527809280:0@lo:103: 00000100:00100000:3.0:1789479907.451610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527809408:0@lo:103: 00010000:00010000:0.0:1789479907.453713:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6400/0xdaa289fda243d089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d082 expref: 21 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.453751:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808000:0@lo:104: 00010000:00010000:0.0:1789479907.453769:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d06d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d066 expref: 20 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.453777:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808128:0@lo:104: 00010000:00010000:0.0:1789479907.453788:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d043 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d03c expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.453798:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808256:0@lo:104: 00010000:00010000:0.0:1789479907.453806:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d027 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d020 expref: 18 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.453813:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808768:0@lo:104: 00010000:00010000:0.0:1789479907.453821:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243cfe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cfe1 expref: 17 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.454150:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479907.454158:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:6512:x1876405527809024:12345-0@lo:104: Request processed in 4335us (4472us total) trans 0 rc 0/0 00010000:00010000:3.0:1789479907.454263:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479907.454271:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.454280:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.454283:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.454293:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.454300:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.454305:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.454345:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.454358:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.454376:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.454382:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7600/0xdaa289fda243cfb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfbe expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.454398:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.454399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.454400:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479907.454421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789479907.454437:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527809536:0@lo:103: 00000100:00100000:3.0:1789479907.454476:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.454521:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809536 00000100:00100000:3.0:1789479907.454527:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809536 00000100:00100000:2.0:1789479907.454638:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479907.454724:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527808896:0@lo:104: 00000100:00100000:0.0:1789479907.454751:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1876405527809024:0@lo:104: 00010000:00010000:0.0:1789479907.454781:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.454796:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.454963:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 17 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.455094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789479907.455103:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+17:3646:x1876405527809536:12345-0@lo:103: 00010000:00010000:3.0:1789479907.455115:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479907.455121:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 17 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455132:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 17 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455145:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243cfbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cfb7 expref: 17 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455178:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455186:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455229:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455236:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455242:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455249:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455254:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789479907.455257:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455265:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455279:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.455288:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479907.455327:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+16:3646:x1876405527809536:12345-0@lo:103: Request processed in 226us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.455343:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789479907.455394:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.455403:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.455419:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d0c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789479907.455431:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789479907.456213:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa24b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+15:3646:x1876405527809152:12345-0@lo:103: Request processed in 5538us (6487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.456223:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479907.458158:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+14:9513:x1876405527807744:12345-0@lo:253: Request processed in 32530us (32737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.458169:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789479907.458230:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527807744:0@lo:253: 10000000:01000000:0.0:1789479907.458244:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789479907.458247:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479907.458248:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789479907.458250:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479907.458251:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789479907.458253:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479907.458254:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479907.458256:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479907.458257:0:9513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789479907.458258:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479907.458260:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789479907.458278:0:9513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6abb3b8800 from lustre-OST0001 10000000:01000000:0.0:1789479907.458306:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789479907.458309:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789479907.458317:0:9513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a6a95c999c0 local copy 10000000:01000000:0.0:1789479907.458320:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789479907.458351:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458361:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458370:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.458395:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809664:0@lo:101: 00000100:00100000:0.0:1789479907.458428:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.458458:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.458481:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809664 00000100:00100000:0.0:1789479907.458486:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809664 00000100:00100000:0.0:1789479907.458518:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789479907.458526:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+14:9513:x1876405527809664:12345-0@lo:101: 00010000:00010000:0.0:1789479907.458538:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479907.458716:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1400/0xdaa289fda243d0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d0cf expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458739:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1400/0xdaa289fda243d0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d0cf expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458749:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1400/0xdaa289fda243d0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0cf expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458757:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1400, rc 0) 00000100:00100000:0.0:1789479907.458787:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:9513:x1876405527809664:12345-0@lo:101: Request processed in 261us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.458793:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789479907.458824:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809664:0@lo:101: 00010000:00010000:0.0:1789479907.458848:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.458857:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.458940:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809792:0@lo:501: 00000100:00100000:0.0:1789479907.458965:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.458979:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.459006:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809792 00000100:00100000:0.0:1789479907.459010:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809792 00000100:00100000:0.0:1789479907.459027:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789479907.459033:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:9513:x1876405527809792:12345-0@lo:501: 00000100:00100000:0.0:1789479907.459095:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:9513:x1876405527809792:12345-0@lo:501: Request processed in 61us (129us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479907.459102:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789479907.459131:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809792:0@lo:501: 10000000:01000000:0.0:1789479907.459141:0:9513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789479907.459156:0:9513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789479907.459160:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459168:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459173:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459207:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789479907.459226:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6abb3b8800 10000000:01000000:0.0:1789479907.459231:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789479907.459235:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789479907.459243:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789479907.459248:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789479907.459250:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789479907.459264:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459271:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459278:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.459289:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809920:0@lo:101: 00000100:00100000:0.0:1789479907.459312:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.459326:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.459338:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527809920 00000100:00100000:0.0:1789479907.459342:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527809920 00000100:00100000:0.0:1789479907.459359:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789479907.459365:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:9513:x1876405527809920:12345-0@lo:101: 00010000:00010000:0.0:1789479907.459371:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479907.459379:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d0dd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459392:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459400:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459407:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1c00, rc 0) 00000100:00100000:0.0:1789479907.459440:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527809920:12345-0@lo:101: Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.459445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789479907.459475:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527809920:0@lo:101: 00010000:00010000:0.0:1789479907.459484:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.459492:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.459534:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810048:0@lo:501: 00000100:00100000:0.0:1789479907.459726:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.459740:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.459752:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810048 00000100:00100000:0.0:1789479907.459756:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810048 00000100:00100000:0.0:1789479907.459772:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789479907.459778:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810048:12345-0@lo:501: 00000100:00100000:0.0:1789479907.459921:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810048:12345-0@lo:501: Request processed in 142us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.459928:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789479907.459957:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810048:0@lo:501: 00000100:00100000:0.0:1789479907.459980:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810176:0@lo:503: 00000100:00100000:0.0:1789479907.460278:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.460291:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.460304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810176 00000100:00100000:0.0:1789479907.460308:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810176 00000100:00100000:0.0:1789479907.460326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789479907.460338:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810176:12345-0@lo:503: 00000100:00100000:0.0:1789479907.460407:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810176:12345-0@lo:503: Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.460413:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789479907.460448:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810176:0@lo:503: 00000040:00080000:0.0:1789479907.460674:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479907.460733:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810304:0@lo:502: 00000100:00100000:0.0:1789479907.460768:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.460783:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.460795:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810304 00000100:00100000:0.0:1789479907.460799:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810304 00000100:00100000:0.0:1789479907.460817:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789479907.460823:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810304:12345-0@lo:502: 00000100:00100000:0.0:1789479907.462466:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810304:12345-0@lo:502: Request processed in 1637us (1692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.462476:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789479907.462536:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810304:0@lo:502: 00000040:00080000:0.0:1789479907.462905:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789479907.463035:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789479907.463052:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789479907.463067:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789479907.463093:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789479907.463109:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789479907.463138:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810432:0@lo:502: 00000100:00100000:0.0:1789479907.463177:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.463214:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.463233:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810432 00000100:00100000:0.0:1789479907.463244:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810432 00000100:00100000:0.0:1789479907.463270:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789479907.463277:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810432:12345-0@lo:502: 00000100:00100000:0.0:1789479907.463355:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810432:12345-0@lo:502: Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.463361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789479907.463400:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810432:0@lo:502: 00000040:00080000:0.0:1789479907.463434:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789479907.463442:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:2.0:1789479907.465295:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527809536:0@lo:103: 00000100:00100000:2.0:1789479907.465308:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527809152:0@lo:103: 00010000:00010000:2.0:1789479907.465337:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789479907.465345:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.465356:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1e00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479907.465360:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.465370:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479907.465377:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479907.465384:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479907.465411:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.465417:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789479907.465475:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789479907.465496:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.465503:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1e00/0xdaa289fda243d0cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdaa289fda243d0d6 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.465516:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479907.465518:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479907.465519:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789479907.466131:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789479907.466139:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789479907.466146:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479907.466148:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789479907.466154:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479907.466167:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a6986984d40) 00000020:00000080:2.0:1789479907.466214:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789479907.466221:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789479907.466279:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789479907.466286:0:9526:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789479907.466292:0:9526:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdaa289fda243d0f2 00000100:00100000:1.0:1789479907.467415:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527810560:0@lo:103: 00000100:00100000:1.0:1789479907.467471:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479907.467621:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810560 00000100:00100000:2.0:1789479907.467629:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810560 00000100:00100000:2.0:1789479907.467671:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789479907.467679:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527810560:12345-0@lo:103: 00010000:00010000:2.0:1789479907.467691:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479907.467707:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1400/0xdaa289fda243d0d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d0cf expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479907.467720:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479907.467763:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+15:3645:x1876405527810560:12345-0@lo:103: Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.467770:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479907.467971:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527810560:0@lo:103: 00010000:00010000:3.0:1789479907.473135:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1789479907.473528:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789479907.477289:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789479907.478169:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789479907.488176:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789479907.488392:0:9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789479907.495634:0:9526:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789479907.500304:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789479907.500314:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479907.500318:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479907.500320:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789479907.500322:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479907.500325:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479907.500327:0:9526:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789479907.500329:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789479907.500330:0:9526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789479907.500350:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479907.500352:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479907.500353:0:9526:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789479907.500356:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789479907.500728:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789479907.500752:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789479907.500769:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.500778:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479907.500784:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8800 from 1 10000000:01000000:0.0:1789479907.500785:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789479907.500815:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.500820:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.500830:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.500851:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810688:0@lo:101: 00000100:00100000:0.0:1789479907.500924:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.500972:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479907.501128:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810688 00000100:00100000:1.0:1789479907.501135:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810688 00000100:00100000:1.0:1789479907.501319:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789479907.501329:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+15:9513:x1876405527810688:12345-0@lo:101: 00010000:00010000:1.0:1789479907.501347:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479907.501360:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d0f9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.501383:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.501393:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.501405:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81475000, rc 0) 00000100:00100000:1.0:1789479907.501444:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810688:12345-0@lo:101: Request processed in 117us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.501450:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789479907.501477:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810688:0@lo:101: 00010000:00010000:0.0:1789479907.501490:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.501499:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.501580:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810816:0@lo:501: 00000100:00100000:0.0:1789479907.501611:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.501636:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479907.501649:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810816 00000100:00100000:1.0:1789479907.501653:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810816 00000100:00100000:1.0:1789479907.501685:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789479907.501691:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810816:12345-0@lo:501: 00000100:00100000:1.0:1789479907.501779:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810816:12345-0@lo:501: Request processed in 87us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.501785:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789479907.501802:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810816:0@lo:501: 00000100:00100000:0.0:1789479907.501851:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810944:0@lo:503: 00000100:00100000:0.0:1789479907.501889:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.501918:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479907.501935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527810944 00000100:00100000:1.0:1789479907.501939:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527810944 00000100:00100000:1.0:1789479907.501965:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789479907.501971:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810944:12345-0@lo:503: 00000100:00100000:1.0:1789479907.502056:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527810944:12345-0@lo:503: Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.502063:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789479907.502092:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527810944:0@lo:503: 00000040:00080000:0.0:1789479907.502311:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789479907.502366:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811072:0@lo:502: 00000100:00100000:0.0:1789479907.502397:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.502425:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479907.502473:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811072 00000100:00100000:1.0:1789479907.502478:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811072 00000100:00100000:1.0:1789479907.502508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789479907.502520:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527811072:12345-0@lo:502: 00000100:00100000:1.0:1789479907.502609:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527811072:12345-0@lo:502: Request processed in 95us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.502615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789479907.502751:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811072:0@lo:502: 00000040:00080000:1.0:1789479907.503667:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789479907.503699:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789479907.503726:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811200:0@lo:502: 00000100:00100000:1.0:1789479907.503938:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.504009:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.504141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811200 00000100:00100000:0.0:1789479907.504147:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811200 00000100:00100000:0.0:1789479907.504275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789479907.504283:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527811200:12345-0@lo:502: 00000100:00100000:0.0:1789479907.504379:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527811200:12345-0@lo:502: Request processed in 97us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.504391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789479907.504457:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811200:0@lo:502: 00000040:00080000:2.0:1789479907.504502:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789479907.504515:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789479907.505226:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479907.505235:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479907.505238:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789479907.505245:0:9530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6abb3b8800 00000020:00000080:3.0:1789479907.505247:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789479907.505259:0:9530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479907.505262:0:9530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479907.505263:0:9530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789479907.505266:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789479907.505314:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789479907.505334:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479907.505344:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.505354:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479907.505393:0:9513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789479907.505396:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6abb3b8800 10000000:01000000:0.0:1789479907.505399:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6abb3b8800 10000000:01000000:0.0:1789479907.505415:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789479907.505421:0:9513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6abb3b8800 from 1 10000000:01000000:0.0:1789479907.505424:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479907.505448:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.505457:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.505465:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.505480:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811328:0@lo:101: 00000100:00100000:0.0:1789479907.505513:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.505674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811328 00000100:00100000:3.0:1789479907.505680:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811328 00000100:00100000:3.0:1789479907.505709:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789479907.505717:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:9513:x1876405527811328:12345-0@lo:101: 00010000:00010000:3.0:1789479907.505727:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479907.505738:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d107 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.505771:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d107 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.505781:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d107 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.505789:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7600, rc 0) 00000100:00100000:3.0:1789479907.505820:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811328:12345-0@lo:101: Request processed in 104us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.505827:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789479907.505920:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.505936:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811328:0@lo:101: 00010000:00010000:0.0:1789479907.505947:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.505961:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.506017:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811456:0@lo:501: 00000100:00100000:0.0:1789479907.506164:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.506182:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.506211:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811456 00000100:00100000:0.0:1789479907.506215:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811456 00000100:00100000:0.0:1789479907.506238:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789479907.506244:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811456:12345-0@lo:501: 00000100:00100000:0.0:1789479907.506316:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811456:12345-0@lo:501: Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.506322:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789479907.506347:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811456:0@lo:501: 00000100:00100000:0.0:1789479907.506377:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811584:0@lo:503: 00000100:00100000:0.0:1789479907.506406:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.506417:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789479907.506510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811584 00000100:00100000:3.0:1789479907.506515:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811584 00000100:00100000:3.0:1789479907.506912:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789479907.506919:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811584:12345-0@lo:503: 00000100:00100000:3.0:1789479907.507126:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811584:12345-0@lo:503: Request processed in 207us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.507134:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789479907.507231:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811584:0@lo:503: 00000040:00080000:1.0:1789479907.507421:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789479907.507477:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811712:0@lo:502: 00000100:00100000:1.0:1789479907.507508:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.507543:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479907.507570:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811712 00000100:00100000:3.0:1789479907.507575:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811712 00000100:00100000:3.0:1789479907.507590:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789479907.507595:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811712:12345-0@lo:502: 00000100:00100000:3.0:1789479907.507666:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811712:12345-0@lo:502: Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.507673:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789479907.507689:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811712:0@lo:502: 00000040:00080000:1.0:1789479907.507843:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789479907.507868:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789479907.507881:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789479907.507894:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789479907.507916:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789479907.507945:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789479907.507958:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789479907.507968:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789479907.507978:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789479907.507987:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789479907.507997:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789479907.508007:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789479907.508016:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789479907.508026:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789479907.508036:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789479907.508047:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789479907.508060:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789479907.508084:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789479907.508100:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789479907.508124:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789479907.508136:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789479907.508154:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789479907.508166:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789479907.508177:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789479907.508187:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789479907.508225:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789479907.508239:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789479907.508252:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1789479907.508263:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1789479907.508273:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1789479907.508282:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1789479907.508292:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1789479907.508302:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1789479907.508312:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1789479907.508323:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1789479907.508337:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1789479907.508348:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1789479907.508367:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1789479907.508378:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:1.0:1789479907.508388:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:1.0:1789479907.508398:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:1.0:1789479907.508407:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1789479907.508416:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1789479907.508425:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1789479907.508435:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1789479907.508444:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1789479907.508465:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811840:0@lo:502: 00000100:00100000:1.0:1789479907.508501:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.508523:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332600 going to sleep for 11 seconds 00000100:00100000:0.0:1789479907.508644:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811840 00000100:00100000:0.0:1789479907.508651:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811840 00000100:00100000:0.0:1789479907.508681:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789479907.508686:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811840:12345-0@lo:502: 00000100:00100000:0.0:1789479907.508756:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527811840:12345-0@lo:502: Request processed in 69us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.508763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789479907.508781:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527811840:0@lo:502: 00000040:00080000:1.0:1789479907.508837:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789479907.508844:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789479907.509556:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789479907.509591:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a698794cd40) 00000020:00000080:0.0:1789479907.509616:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789479907.509735:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789479907.509739:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789479907.509742:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8800 3 00010000:00080000:0.0:1789479907.509774:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6981c91800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789479907.512326:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789479907.512504:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789479907.512544:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789479907.512555:0:9531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdaa289fda243d11c 00000100:00080000:0.0:1789479907.512564:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789479907.512574:0:9531:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a6981c91800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789479907.512612:0:9531:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1d500 x1876405527811968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789479907.512663:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527811968:0@lo:38: 00000100:00100000:3.0:1789479907.512722:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789479907.512795:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789479907.512876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527811968 00000100:00100000:1.0:1789479907.512884:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527811968 00000100:00100000:1.0:1789479907.512921:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789479907.512928:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876405527811968:12345-0@lo:38: 00010000:00080000:1.0:1789479907.512949:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:1.0:1789479907.512974:0:6521:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdaa289fda243d123 00000004:00100000:1.0:1789479907.512986:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789479907.513011:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479907.513070:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876405527811968:12345-0@lo:38: Request processed in 141us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.513085:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789479907.513106:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6986a1d500 x1876405527811968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.513115:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479907.513122:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789479907.513128:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789479907.513132:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789479907.513134:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789479907.513139:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527811968:0@lo:38: 00000100:00100000:1.0:1789479907.513167:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527812096:0@lo:400: 00000100:00100000:1.0:1789479907.513209:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513227:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812096 00000100:00100000:3.0:1789479907.513231:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812096 00000100:00100000:1.0:1789479907.513240:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527812608:0@lo:400: 00000100:00100000:3.0:1789479907.513259:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479907.513259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513266:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527812096:12345-0@lo:400: 00000100:00100000:1.0:1789479907.513274:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789479907.513279:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527812224:0@lo:400: 00000100:00100000:3.0:1789479907.513297:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527812096:12345-0@lo:400: Request processed in 32us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.513300:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513303:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789479907.513313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527812736:0@lo:400: 00000100:00100000:3.0:1789479907.513325:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812608 00000100:00100000:3.0:1789479907.513328:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812608 00000100:00100000:1.0:1789479907.513330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789479907.513346:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b1500 x1876405527812096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.513348:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812736 00000100:00100000:3.0:1789479907.513350:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812736 00000100:00100000:1.0:1789479907.513356:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527812096:0@lo:400: 00000100:00100000:3.0:1789479907.513362:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789479907.513367:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527812608:12345-0@lo:400: 00000100:00100000:1.0:1789479907.513376:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527812352:0@lo:400: 00000100:00100000:3.0:1789479907.513398:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527812608:12345-0@lo:400: Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.513402:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513405:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789479907.513411:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527812864:0@lo:400: 00000100:00100000:3.0:1789479907.513414:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812352 00000100:00100000:3.0:1789479907.513417:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812352 00000100:00100000:3.0:1789479907.513428:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479907.513433:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527812736:12345-0@lo:400: 00000100:00100000:1.0:1789479907.513433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.513449:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479907.513454:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527812480:0@lo:400: 00000100:00100000:3.0:1789479907.513465:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527812736:12345-0@lo:400: Request processed in 32us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.513470:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479907.513481:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789479907.513482:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513486:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527812352:12345-0@lo:400: 00000100:00100000:1.0:1789479907.513497:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527812992:0@lo:400: 00000100:00100000:1.0:1789479907.513515:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513719:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527812352:12345-0@lo:400: Request processed in 232us (315us total) trans 0 rc 0/0 00000020:01000004:0.0:1789479907.513719:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1789479907.513725:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:00000080:0.0:1789479907.513731:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a698794b380) 00000100:00080000:3.0:1789479907.513742:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479907.513745:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1789479907.513745:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00010000:00080000:3.0:1789479907.513760:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b2d80 x1876405527812736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.513769:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527812736:0@lo:400: 00010000:00080000:3.0:1789479907.513777:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b2300 x1876405527812608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.513784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527812608:0@lo:400: 00000020:01000004:0.0:1789479907.513812:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6abb3b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789479907.513816:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789479907.513818:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8800 3 00000100:00100000:3.0:1789479907.513831:0:9532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1876405527813120:0@lo:901: 00010000:00080000:0.0:1789479907.513845:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987a5c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.144@tcp at head 00000100:00100000:3.0:1789479907.513854:0:9532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479907.513877:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813120 00000100:00100000:3.0:1789479907.513881:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813120 00000100:00100000:3.0:1789479907.513906:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789479907.513912:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1876405527813120:12345-0@lo:901: 00000100:00100000:3.0:1789479907.513972:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9532:x1876405527813120:12345-0@lo:901: Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479907.513978:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789479907.513997:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479907.514004:0:9532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891540 going to sleep for 11 seconds 00010000:00080000:3.0:1789479907.514016:0:9532:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6abb5dce00 x1876405527813120/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789479923 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.514025:0:9532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9532:1876405527813120:0@lo:901: 00010000:00010000:0.0:1789479907.515085:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789479907.515275:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789479907.515309:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789479907.515318:0:9531:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdaa289fda243d131 00000100:00080000:0.0:1789479907.515326:0:9531:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789479907.515333:0:9531:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a6987a5c000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789479907.515357:0:9531:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1c000 x1876405527813248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789479907.515383:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789479907.515408:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527813248:0@lo:38: 00000100:00100000:3.0:1789479907.515451:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.515610:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812224 00000100:00100000:1.0:1789479907.515616:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812224 00000100:00100000:1.0:1789479907.515684:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812480 00000100:00100000:1.0:1789479907.515687:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812480 00000100:00100000:3.0:1789479907.515728:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789479907.515734:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813248 00000100:00100000:3.0:1789479907.515737:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527812224:12345-0@lo:400: 00000100:00100000:0.0:1789479907.515738:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813248 00000100:00100000:0.0:1789479907.515758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789479907.515762:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527813248:12345-0@lo:38: 00000100:00100000:3.0:1789479907.515780:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527812224:12345-0@lo:400: Request processed in 45us (2479us total) trans 0 rc 0/0 00010000:00080000:0.0:1789479907.515780:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 276 last 0 00000100:00100000:3.0:1789479907.515787:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789479907.515800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789479907.515805:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527812480:12345-0@lo:400: 00000020:00000080:0.0:1789479907.515813:0:6522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdaa289fda243d138 00000004:00100000:0.0:1789479907.515825:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789479907.515840:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527812480:12345-0@lo:400: Request processed in 35us (2357us total) trans 0 rc 0/0 00000100:00080000:0.0:1789479907.515849:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479907.515859:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789479907.515884:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876405527813248:12345-0@lo:38: Request processed in 121us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479907.515890:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789479907.515895:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527812224:0@lo:400: 00010000:00080000:3.0:1789479907.515919:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6986a1c000 x1876405527813248/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789479917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.515926:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789479907.515931:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789479907.515936:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789479907.515939:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789479907.515941:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789479907.515957:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527813248:0@lo:38: 00000040:00080000:0.0:1789479907.515959:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:1.0:1789479907.516383:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812864 00000100:00100000:1.0:1789479907.516389:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812864 00000100:00100000:1.0:1789479907.516456:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527812992 00000100:00100000:1.0:1789479907.516459:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527812992 00000100:00080000:3.0:1789479907.516488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479907.517331:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479907.517341:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527812864:12345-0@lo:400: 00000100:00100000:1.0:1789479907.517399:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527812864:12345-0@lo:400: Request processed in 60us (3965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.517405:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789479907.517419:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789479907.517425:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527812992:12345-0@lo:400: 00000100:00100000:1.0:1789479907.517450:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527812992:12345-0@lo:400: Request processed in 26us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.517455:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000000:1.0:1789479907.517496:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789479907.517538:0:9513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789479907.517557:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.517568:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789479907.517622:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789479907.517624:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789479907.517626:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789479907.517628:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789479907.517629:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789479907.517630:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789479907.517632:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789479907.517633:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789479907.517634:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789479907.517636:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789479907.517637:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789479907.517641:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789479907.517643:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789479907.517644:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789479907.517645:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789479907.517646:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789479907.517647:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789479907.517649:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789479907.517649:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789479907.517651:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789479907.517652:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789479907.517653:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789479907.517653:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789479907.517671:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789479907.517684:0:9513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527813376:0@lo:253: 00000100:00100000:1.0:1789479907.517720:0:9513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.518561:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527812480:0@lo:400: 00010000:00080000:0.0:1789479907.518580:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b0a80 x1876405527812992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479907.518596:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527812992:0@lo:400: 00010000:00080000:0.0:1789479907.518607:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b3100 x1876405527812352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479907.518615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527812352:0@lo:400: 00010000:00080000:0.0:1789479907.518624:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b2680 x1876405527812864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479907.518632:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527812864:0@lo:400: 00000100:00100000:1.0:1789479907.521012:0:9513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479907.521117:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813376 00000100:00100000:3.0:1789479907.521125:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813376 00000100:00100000:3.0:1789479907.521171:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789479907.521180:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527813376:12345-0@lo:253: 20000000:01000000:3.0:1789479907.521229:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789479907.521243:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789479907.524483:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527813504:0@lo:13: 00000100:00100000:1.0:1789479907.524541:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.524588:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813504 00000100:00100000:1.0:1789479907.524599:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813504 00000100:00100000:1.0:1789479907.524638:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789479907.524647:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527813504:12345-0@lo:13: 00002000:00000024:1.0:1789479907.524672:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479907.524698:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 20000000:01000000:3.0:1789479907.525892:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789479907.525910:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789479907.525996:0:6536:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789479907.526016:0:6536:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789479907.526034:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.526050:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d02e expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.526057:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d074 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.526063:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.526101:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479907.526124:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 17 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.526135:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527813760:0@lo:104: 00000100:00100000:0.0:1789479907.526174:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479907.526236:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527813504:12345-0@lo:13: Request processed in 1396us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.526245:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479907.526394:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813760 00000100:00100000:2.0:1789479907.526400:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813760 00010000:00010000:0.0:1789479907.526425:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479907.526431:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789479907.526433:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 17 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479907.526438:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527813760:12345-0@lo:104: 00000100:00100000:0.0:1789479907.526442:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527813888:0@lo:104: 00010000:00010000:2.0:1789479907.526448:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.526461:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479907.526471:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3337cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789479907.526487:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789479907.526487:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527813760:0@lo:104: 00000100:00100000:2.0:1789479907.526492:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527813760:12345-0@lo:104: Request processed in 56us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.526497:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789479907.526508:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813888 00000100:00100000:2.0:1789479907.526511:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813888 00000100:00100000:2.0:1789479907.526524:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789479907.526528:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527813888:12345-0@lo:104: 00010000:00010000:2.0:1789479907.526535:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479907.526538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527813632:0@lo:13: 00010000:00010000:2.0:1789479907.526566:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789479907.526571:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:6536:x1876405527813888:12345-0@lo:104: Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.526576:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789479907.526641:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479907.526671:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527813632 00010000:00080000:3.0:1789479907.526674:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a69810b2300 x1876405527813504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479907.526674:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527813632 00000100:00100000:3.0:1789479907.526690:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527813504:0@lo:13: 00000100:00100000:2.0:1789479907.526694:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789479907.526704:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527813632:12345-0@lo:13: 00010000:00010000:3.0:1789479907.526709:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479907.526714:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1789479907.526719:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1789479907.526721:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.526725:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526732:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.526738:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.526753:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1789479907.526755:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527813632:12345-0@lo:13: Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479907.526760:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789479907.526777:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526784:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.526802:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479907.526807:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527814016:0@lo:103: 00010000:00010000:3.0:1789479907.526809:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d07b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526819:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789479907.526822:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526827:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789479907.526830:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479907.526845:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789479907.526846:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479907.526852:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479907.526857:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789479907.526870:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526876:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479907.526895:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526901:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d02e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d035 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479907.526912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.526913:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479907.526915:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479907.526930:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527814144:0@lo:103: 00000100:00100000:3.0:1789479907.526954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789479907.526999:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6986a1fb80 x1876405527813632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479907.527010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527813632:0@lo:13: 00010000:00010000:0.0:1789479907.527064:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479907.527090:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6536:1876405527813888:0@lo:104: 00010000:00010000:0.0:1789479907.527103:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.527178:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9513:x1876405527813376:12345-0@lo:253: Request processed in 5999us (9456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.527186:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789479907.527236:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814016 00000100:00100000:1.0:1789479907.527239:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814016 00010000:00010000:1.0:1789479907.527256:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 17 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.527275:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814144 00000100:00100000:1.0:1789479907.527278:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814144 00010000:00010000:1.0:1789479907.527289:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 18 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479907.527305:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789479907.527311:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+18:3645:x1876405527814016:12345-0@lo:103: 00010000:00010000:1.0:1789479907.527320:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479907.527323:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 18 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527330:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 18 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527339:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7e00/0xdaa289fda243d07b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d074 expref: 18 pid: 6514 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527351:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479907.527371:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+17:3645:x1876405527814016:12345-0@lo:103: Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.527374:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789479907.527383:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789479907.527387:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+16:3646:x1876405527814144:12345-0@lo:103: 00010000:00010000:1.0:1789479907.527392:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789479907.527394:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 16 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527399:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 16 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527405:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d035 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d02e expref: 16 pid: 6515 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527411:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527416:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789479907.527424:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003593894s 00010000:00010000:1.0:1789479907.527427:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527431:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527442:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527446:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527449:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0c00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789479907.527451:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527456:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527464:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527469:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789479907.527485:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+15:3646:x1876405527814144:12345-0@lo:103: Request processed in 98us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479907.527489:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789479907.527507:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527814016:0@lo:103: 00010000:00010000:1.0:1789479907.527527:0:6536:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527531:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479907.527535:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d13f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479907.527632:0:9513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6a679393-20ef-489d-b204-2797ec519e97:9513:1876405527813376:0@lo:253: 10000000:01000000:0.0:1789479907.527638:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789479907.527641:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789479907.527642:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789479907.527643:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789479907.527644:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789479907.527645:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789479907.527645:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789479907.527646:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789479907.527647:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789479907.527648:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789479907.527649:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789479907.527650:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789479907.527683:0:9513:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789479907.528251:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527814144:0@lo:103: 00080000:10000000:0.0:1789479907.531887:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1789479907.532057:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789479907.532277:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789479907.532426:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789479907.532771:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789479907.532966:0:9513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1789479907.533917:0:9513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789479907.540696:0:9513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789479907.540705:0:9513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789479907.540741:0:9513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789479907.540779:0:9513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789479907.540796:0:9513:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789479907.540811:0:9513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789479907.543785:0:9513:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789479907.543965:0:9513:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789479907.652303:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479908.039930:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479908.039955:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527814272:0@lo:41: 00000100:00100000:1.0:1789479908.040018:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479908.041566:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814272 00000100:00100000:3.0:1789479908.041576:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814272 00000100:00100000:3.0:1789479908.041629:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479908.041637:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527814272:12345-0@lo:41: 00000004:00000024:3.0:1789479908.041670:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789479908.041740:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527814272:12345-0@lo:41: Request processed in 104us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479908.041746:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789479908.041848:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527814272:0@lo:41: 00000020:00000004:1.0:1789479908.597718:0:9587:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479908.597928:0:9587:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789479908.680325:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479909.700850:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479910.085984:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479910.086018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527814400:0@lo:41: 00000100:00100000:2.0:1789479910.086115:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479910.086373:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814400 00000100:00100000:3.0:1789479910.086385:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814400 00000100:00100000:3.0:1789479910.086454:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479910.086465:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527814400:12345-0@lo:41: 00000004:00000024:3.0:1789479910.086531:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789479910.086600:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527814400:12345-0@lo:41: Request processed in 137us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479910.086607:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479910.086658:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527814400:0@lo:41: 00010000:00010000:2.0:1789479910.725528:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479911.749396:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479912.645058:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527814656:0@lo:400: 00000100:00100000:0.0:1789479912.645118:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645163:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527815168:0@lo:400: 00000100:00100000:0.0:1789479912.645181:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645238:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527815680:0@lo:400: 00000100:00100000:0.0:1789479912.645260:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645281:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789479912.645286:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527814528:0@lo:400: 00000100:00100000:0.0:1789479912.645310:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645328:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527815040:0@lo:400: 00000100:00100000:0.0:1789479912.645346:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645359:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527815552:0@lo:400: 00000100:00100000:0.0:1789479912.645376:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645397:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527814784:0@lo:400: 00000100:00100000:0.0:1789479912.645448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645468:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527815296:0@lo:400: 00000100:00100000:0.0:1789479912.645487:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645499:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527815808:0@lo:400: 00000100:00100000:0.0:1789479912.645518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645529:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789479912.645541:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527814912:0@lo:400: 00000100:00100000:0.0:1789479912.645564:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527815424:0@lo:400: 00000100:00100000:0.0:1789479912.645593:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479912.645622:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814656 00000100:00100000:0.0:1789479912.645629:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814656 00000100:00100000:0.0:1789479912.645662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815168 00000100:00100000:0.0:1789479912.645664:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815168 00000100:00100000:0.0:1789479912.645685:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815680 00000100:00100000:0.0:1789479912.645687:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815680 00000100:00100000:0.0:1789479912.645696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815296 00000100:00100000:0.0:1789479912.645699:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815296 00000100:00100000:0.0:1789479912.645710:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815808 00000100:00100000:0.0:1789479912.645712:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815808 00000100:00100000:0.0:1789479912.645722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814912 00000100:00100000:0.0:1789479912.645724:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814912 00000100:00100000:0.0:1789479912.645750:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789479912.645757:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527814656:12345-0@lo:400: 00000100:00100000:0.0:1789479912.645801:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527814656:12345-0@lo:400: Request processed in 45us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.645808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789479912.645823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789479912.645829:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527815168:12345-0@lo:400: 00000100:00100000:0.0:1789479912.645854:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527815168:12345-0@lo:400: Request processed in 26us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.645860:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789479912.645870:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789479912.645876:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527815680:12345-0@lo:400: 00000100:00100000:0.0:1789479912.645900:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527815680:12345-0@lo:400: Request processed in 24us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.645911:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789479912.645923:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789479912.645928:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527815296:12345-0@lo:400: 00000100:00100000:0.0:1789479912.645959:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527815296:12345-0@lo:400: Request processed in 31us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.645964:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789479912.645975:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789479912.645981:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527815808:12345-0@lo:400: 00000100:00100000:0.0:1789479912.646007:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527815808:12345-0@lo:400: Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.646013:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789479912.646024:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789479912.646029:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527814912:12345-0@lo:400: 00000100:00100000:0.0:1789479912.646067:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527814912:12345-0@lo:400: Request processed in 38us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.646072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789479912.646098:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815040 00000100:00100000:0.0:1789479912.646101:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815040 00000100:00100000:0.0:1789479912.646121:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814784 00000100:00100000:0.0:1789479912.646124:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814784 00000100:00100000:0.0:1789479912.646136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789479912.646142:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527815040:12345-0@lo:400: 00000100:00100000:0.0:1789479912.646172:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527815040:12345-0@lo:400: Request processed in 31us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.646178:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789479912.646212:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789479912.646225:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527814784:12345-0@lo:400: 00000100:00100000:0.0:1789479912.646254:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527814784:12345-0@lo:400: Request processed in 31us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479912.646259:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789479912.646279:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479912.646282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479912.646308:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527815040:0@lo:400: 00010000:00080000:0.0:1789479912.646322:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1c700 x1876405527814656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646332:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527814656:0@lo:400: 00010000:00080000:0.0:1789479912.646342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1c380 x1876405527815168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646351:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527815168:0@lo:400: 00010000:00080000:0.0:1789479912.646361:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f4000 x1876405527815680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527815680:0@lo:400: 00010000:00080000:0.0:1789479912.646401:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1f100 x1876405527814912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646410:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527814912:0@lo:400: 00000100:00100000:0.0:1789479912.646420:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527814784:0@lo:400: 00010000:00080000:0.0:1789479912.646429:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1f480 x1876405527815296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646437:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527815296:0@lo:400: 00010000:00080000:0.0:1789479912.646457:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f6a00 x1876405527815808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479912.646465:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527815808:0@lo:400: 00000100:00100000:1.0:1789479912.646818:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815552 00000100:00100000:1.0:1789479912.646823:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815552 00000100:00100000:1.0:1789479912.646857:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815424 00000100:00100000:1.0:1789479912.646861:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815424 00000100:00100000:1.0:1789479912.646882:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789479912.646890:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527815552:12345-0@lo:400: 00000100:00100000:1.0:1789479912.646934:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527815552:12345-0@lo:400: Request processed in 46us (1556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479912.646940:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789479912.646953:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789479912.646959:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527815424:12345-0@lo:400: 00000100:00100000:1.0:1789479912.646990:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527815424:12345-0@lo:400: Request processed in 31us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479912.646996:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789479912.647030:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1fb80 x1876405527815424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479912.647040:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527815424:0@lo:400: 00010000:00080000:1.0:1789479912.647078:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f4700 x1876405527815552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479912.647087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527815552:0@lo:400: 00000100:00080000:0.0:1789479912.647693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479912.647789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527814528 00000100:00100000:2.0:1789479912.647796:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527814528 00000100:00100000:2.0:1789479912.647830:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789479912.647838:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:3646:x1876405527814528:12345-0@lo:400: 00000100:00100000:2.0:1789479912.647899:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+15:3646:x1876405527814528:12345-0@lo:400: Request processed in 63us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479912.647906:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789479912.648000:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527814528:0@lo:400: 00000100:00100000:2.0:1789479912.648859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527815936:0@lo:13: 00000100:00100000:2.0:1789479912.648894:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479912.648941:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527815936 00000100:00100000:2.0:1789479912.648946:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527815936 00000100:00100000:2.0:1789479912.648972:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789479912.648979:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527815936:12345-0@lo:13: 00002000:00000024:2.0:1789479912.649001:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479912.649039:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527815936:12345-0@lo:13: Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479912.649045:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789479912.649097:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504700 x1876405527815936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479912.649111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527815936:0@lo:13: 00000100:00100000:1.0:1789479912.649264:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479912.649273:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527816064:0@lo:13: 00000100:00100000:1.0:1789479912.649301:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479912.649325:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816064 00000100:00100000:1.0:1789479912.649329:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816064 00000100:00100000:1.0:1789479912.649352:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789479912.649358:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527816064:12345-0@lo:13: 00002000:00000024:1.0:1789479912.649369:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479912.649411:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527816064:12345-0@lo:13: Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479912.649416:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789479912.649622:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b2300 x1876405527816064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479912.649635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527816064:0@lo:13: 00010000:00010000:0.0:1789479912.774272:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479913.158945:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479913.158968:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527816192:0@lo:41: 00000100:00100000:3.0:1789479913.159041:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479913.159121:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816192 00000100:00100000:3.0:1789479913.159128:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816192 00000100:00100000:3.0:1789479913.159173:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789479913.159181:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527816192:12345-0@lo:41: 00000004:00000024:3.0:1789479913.159233:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1789479913.159277:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527816192:12345-0@lo:41: Request processed in 97us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479913.159283:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789479913.159325:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527816192:0@lo:41: 00010000:00010000:2.0:1789479913.796448:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479914.824401:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789479915.207103:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789479915.207110:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6abb3b8000 from 39 10000000:01000000:0.0:1789479915.207114:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479915.207158:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207170:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207182:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.207227:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816320:0@lo:101: 00000100:00100000:0.0:1789479915.207370:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.207420:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.207440:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816320 00000100:00100000:0.0:1789479915.207447:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816320 00000100:00100000:0.0:1789479915.207491:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789479915.207499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527816320:12345-0@lo:101: 00010000:00010000:0.0:1789479915.207511:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.207523:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d146 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207545:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d146 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207564:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d146 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207572:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:0.0:1789479915.207604:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527816320:12345-0@lo:101: Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.207611:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789479915.207650:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816320:0@lo:101: 00010000:00010000:0.0:1789479915.207662:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.207671:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.207940:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527816448:0@lo:41: 00000100:00100000:1.0:1789479915.207979:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.208015:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816448 00000100:00100000:1.0:1789479915.208019:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816448 00000100:00100000:1.0:1789479915.208062:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789479915.208069:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527816448:12345-0@lo:41: 00000004:00000024:1.0:1789479915.208092:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789479915.208127:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527816448:12345-0@lo:41: Request processed in 59us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.208134:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789479915.208167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527816448:0@lo:41: 00000100:00100000:0.0:1789479915.208844:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816576:0@lo:501: 00000100:00100000:0.0:1789479915.208874:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.208896:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.209006:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816576 00000100:00100000:1.0:1789479915.209012:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816576 00000100:00100000:1.0:1789479915.209116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789479915.209125:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527816576:12345-0@lo:501: 00000100:00100000:1.0:1789479915.209265:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527816576:12345-0@lo:501: Request processed in 141us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.209272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789479915.209516:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816576:0@lo:501: 00000100:00100000:2.0:1789479915.209550:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816704:0@lo:503: 00000100:00100000:2.0:1789479915.209589:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.209619:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.210141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816704 00000100:00100000:0.0:1789479915.210147:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816704 00000100:00100000:0.0:1789479915.210184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789479915.210220:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527816704:12345-0@lo:503: 00000100:00100000:0.0:1789479915.210384:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527816704:12345-0@lo:503: Request processed in 192us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.210391:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789479915.210509:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527816704:0@lo:503: 00000100:00100000:0.0:1789479915.211362:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9869:1876405527816832:0@lo:502: 00000100:00100000:0.0:1789479915.211411:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.211444:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.211615:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816832 00000100:00100000:2.0:1789479915.211621:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816832 00000100:00100000:2.0:1789479915.211659:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789479915.211668:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:9869:x1876405527816832:12345-0@lo:502: 00000100:00100000:2.0:1789479915.211776:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:9869:x1876405527816832:12345-0@lo:502: Request processed in 109us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.211783:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789479915.211917:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9869:1876405527816832:0@lo:502: 00000100:00100000:0.0:1789479915.211958:0:9869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9869:1876405527816960:0@lo:502: 00000100:00100000:0.0:1789479915.211991:0:9869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.212013:0:9869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.212109:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527816960 00000100:00100000:2.0:1789479915.212113:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527816960 00000100:00100000:2.0:1789479915.212142:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789479915.212149:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9869:x1876405527816960:12345-0@lo:502: 00000100:00100000:2.0:1789479915.212247:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:9869:x1876405527816960:12345-0@lo:502: Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.212253:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789479915.212352:0:9869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9869:1876405527816960:0@lo:502: 00000040:00080000:3.0:1789479915.212371:0:9869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789479915.212563:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789479915.212584:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479915.212593:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.212610:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479915.212620:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789479915.212622:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789479915.212625:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789479915.212650:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.212657:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.212667:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.212679:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817088:0@lo:101: 00000100:00100000:2.0:1789479915.212719:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.212733:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d3bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.212974:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817088 00000100:00100000:0.0:1789479915.212979:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817088 00000100:00100000:0.0:1789479915.213003:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789479915.213010:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527817088:12345-0@lo:101: 00010000:00010000:0.0:1789479915.213018:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.213102:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d154 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.213125:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d154 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.213142:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d154 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.213151:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0000, rc 0) 00000100:00100000:0.0:1789479915.213571:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817088:12345-0@lo:101: Request processed in 560us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.213578:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789479915.215959:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817088:0@lo:101: 00010000:00010000:3.0:1789479915.215984:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479915.215997:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479915.216829:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817216:0@lo:501: 00000100:00100000:3.0:1789479915.216889:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.217135:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0840 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.220435:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817216 00000100:00100000:0.0:1789479915.220447:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817216 00000100:00100000:0.0:1789479915.220499:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789479915.220509:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817216:12345-0@lo:501: 00000100:00100000:0.0:1789479915.220666:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817216:12345-0@lo:501: Request processed in 158us (3777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.220679:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789479915.222451:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817216:0@lo:501: 00000100:00100000:3.0:1789479915.222504:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817344:0@lo:503: 00000100:00100000:3.0:1789479915.222559:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.222600:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.222644:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817344 00000100:00100000:2.0:1789479915.222651:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817344 00000100:00100000:2.0:1789479915.222702:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789479915.222711:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817344:12345-0@lo:503: 00000100:00100000:2.0:1789479915.222813:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817344:12345-0@lo:503: Request processed in 103us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.222820:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789479915.222934:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817344:0@lo:503: 00000100:00100000:3.0:1789479915.228009:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9873:1876405527817472:0@lo:502: 00000100:00100000:3.0:1789479915.229184:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.229244:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.229395:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817472 00000100:00100000:2.0:1789479915.229403:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817472 00000100:00100000:2.0:1789479915.229454:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789479915.229469:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9873:x1876405527817472:12345-0@lo:502: 00000100:00100000:2.0:1789479915.229589:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9873:x1876405527817472:12345-0@lo:502: Request processed in 121us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.229596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789479915.230412:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9873:1876405527817472:0@lo:502: 00000020:01000000:2.0:1789479915.230448:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789479915.230456:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479915.230459:0:9873:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789479915.230464:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789479915.230466:0:9873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789479915.230493:0:9873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9873:1876405527817600:0@lo:502: 00000100:00100000:2.0:1789479915.230538:0:9873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.230561:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817600 00000100:00100000:2.0:1789479915.230565:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817600 00000100:00100000:2.0:1789479915.230587:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789479915.230593:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9873:x1876405527817600:12345-0@lo:502: 00000100:00100000:2.0:1789479915.230659:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:9873:x1876405527817600:12345-0@lo:502: Request processed in 65us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.230666:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789479915.230841:0:9873:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d0f300 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.230854:0:9873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9873:1876405527817600:0@lo:502: 00000020:01000000:2.0:1789479915.230874:0:9873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479915.230878:0:9873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479915.230879:0:9873:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789479915.230883:0:9873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789479915.230938:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789479915.230957:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789479915.230966:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.230982:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479915.230992:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789479915.230995:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a866ce000 from 39 10000000:01000000:2.0:1789479915.230997:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789479915.231019:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.231103:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.231114:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.231127:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817728:0@lo:101: 00000100:00100000:2.0:1789479915.231154:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.231283:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d0f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.231858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817728 00000100:00100000:0.0:1789479915.231865:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817728 00000100:00100000:0.0:1789479915.231908:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789479915.231916:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527817728:12345-0@lo:101: 00010000:00010000:0.0:1789479915.231927:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.231939:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d162 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.231960:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d162 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.231970:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d162 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.231979:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0800, rc 0) 00000100:00100000:1.0:1789479915.232154:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817728:0@lo:101: 00010000:00010000:1.0:1789479915.232169:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.232179:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.232265:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817856:0@lo:501: 00000100:00100000:1.0:1789479915.233108:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.233144:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a99129000 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.233162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817856 00000100:00100000:1.0:1789479915.233166:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817856 00000100:00100000:1.0:1789479915.233209:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789479915.233215:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527817856:12345-0@lo:501: 00000100:00100000:1.0:1789479915.233393:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527817856:12345-0@lo:501: Request processed in 178us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.233400:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789479915.233438:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817856:0@lo:501: 00000100:00100000:1.0:1789479915.233470:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817984:0@lo:503: 00000100:00100000:1.0:1789479915.233514:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.233531:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a99129000 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.233542:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527817984 00000100:00100000:1.0:1789479915.233545:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527817984 00000100:00100000:1.0:1789479915.233562:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789479915.233568:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527817984:12345-0@lo:503: 00000100:00100000:1.0:1789479915.233641:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527817984:12345-0@lo:503: Request processed in 73us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.233647:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789479915.233680:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527817984:0@lo:503: 00000100:00100000:0.0:1789479915.233786:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527817728:12345-0@lo:101: Request processed in 113us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.233793:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789479915.235637:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9876:1876405527818112:0@lo:502: 00000100:00100000:0.0:1789479915.236873:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.236917:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.237159:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818112 00000100:00100000:1.0:1789479915.237166:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818112 00000100:00100000:1.0:1789479915.237232:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789479915.237240:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:9876:x1876405527818112:12345-0@lo:502: 00000100:00100000:1.0:1789479915.238222:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:9876:x1876405527818112:12345-0@lo:502: Request processed in 979us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.238232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789479915.239163:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9876:1876405527818112:0@lo:502: 00000100:00100000:0.0:1789479915.239255:0:9876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9876:1876405527818240:0@lo:502: 00000100:00100000:0.0:1789479915.239395:0:9876:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.239433:0:9876:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.239514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818240 00000100:00100000:1.0:1789479915.239521:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818240 00000100:00100000:1.0:1789479915.239561:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789479915.239570:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:9876:x1876405527818240:12345-0@lo:502: 00000100:00100000:1.0:1789479915.239671:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:9876:x1876405527818240:12345-0@lo:502: Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.239678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789479915.240524:0:9876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9876:1876405527818240:0@lo:502: 00000040:00080000:0.0:1789479915.240559:0:9876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789479915.240769:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789479915.240822:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789479915.240832:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.240850:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479915.240859:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789479915.240862:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a866ce000 from 6 10000000:01000000:1.0:1789479915.240865:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789479915.240892:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.240901:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479915.240910:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479915.240926:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818368:0@lo:101: 00000100:00100000:1.0:1789479915.240964:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.241000:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa3720180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.241805:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818368 00000100:00100000:0.0:1789479915.241812:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818368 00000100:00100000:0.0:1789479915.241845:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789479915.241853:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527818368:12345-0@lo:101: 00010000:00010000:0.0:1789479915.241867:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.241882:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243d177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d170 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.241905:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243d177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d170 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.241914:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243d177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d170 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.241922:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0600, rc 0) 00000100:00100000:0.0:1789479915.241969:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527818368:12345-0@lo:101: Request processed in 116us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.241976:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789479915.242015:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818368:0@lo:101: 00010000:00010000:0.0:1789479915.242446:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.242457:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.242513:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818496:0@lo:256: 00000100:00100000:0.0:1789479915.242547:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.242577:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.242772:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818496 00000100:00100000:1.0:1789479915.242779:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818496 00000100:00100000:1.0:1789479915.242813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789479915.242821:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527818496:12345-0@lo:256: 20000000:01000000:1.0:1789479915.242837:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789479915.242853:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789479915.242856:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789479915.242935:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527818496:12345-0@lo:256: Request processed in 115us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.242942:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789479915.243809:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818496:0@lo:256: 10000000:01000000:0.0:1789479915.243860:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789479915.243868:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.243878:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.243887:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789479915.243890:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1789479915.243892:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789479915.243916:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.243924:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.243933:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.243946:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818624:0@lo:101: 00000100:00100000:0.0:1789479915.243976:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.244001:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.244013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818624 00000100:00100000:0.0:1789479915.244017:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818624 00000100:00100000:0.0:1789479915.245124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789479915.245136:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527818624:12345-0@lo:101: 00010000:00010000:0.0:1789479915.245150:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.245170:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d17e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.245224:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d17e expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.245235:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d17e expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.245242:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1800, rc 0) 00000100:00100000:0.0:1789479915.245302:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527818624:12345-0@lo:101: Request processed in 159us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.245309:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789479915.245387:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818624:0@lo:101: 00010000:00010000:2.0:1789479915.245402:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.245411:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.245469:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818752:0@lo:501: 00000100:00100000:2.0:1789479915.245498:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.245995:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d0f600 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.246032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818752 00000100:00100000:1.0:1789479915.246045:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818752 00000100:00100000:3.0:1789479915.246093:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789479915.246103:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527818752:12345-0@lo:501: 00000100:00100000:3.0:1789479915.246244:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527818752:12345-0@lo:501: Request processed in 143us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.246251:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789479915.246429:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818752:0@lo:501: 00000100:00100000:2.0:1789479915.246459:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818880:0@lo:503: 00000100:00100000:2.0:1789479915.246499:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.246520:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95d0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.246562:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527818880 00000100:00100000:3.0:1789479915.246566:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527818880 00000100:00100000:3.0:1789479915.246584:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789479915.246589:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527818880:12345-0@lo:503: 00000100:00100000:3.0:1789479915.246708:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527818880:12345-0@lo:503: Request processed in 118us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479915.246715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789479915.247545:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527818880:0@lo:503: 00000100:00100000:3.0:1789479915.254594:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9877:1876405527819008:0@lo:502: 00000100:00100000:3.0:1789479915.254667:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.254792:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819008 00000100:00100000:1.0:1789479915.254799:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819008 00000100:00100000:1.0:1789479915.254838:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789479915.254846:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:9877:x1876405527819008:12345-0@lo:502: 00000100:00100000:3.0:1789479915.254971:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0840 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.255224:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:9877:x1876405527819008:12345-0@lo:502: Request processed in 377us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.255233:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789479915.256588:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9877:1876405527819008:0@lo:502: 00000020:01000000:2.0:1789479915.256666:0:9877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789479915.256673:0:9877:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789479915.256682:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479915.256750:0:9877:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789479915.256757:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789479915.256761:0:9877:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1789479915.256783:0:9877:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789479915.256786:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789479915.256801:0:9877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a6986983380) 00000020:00000080:2.0:1789479915.256824:0:9877:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789479915.256829:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789479915.256908:0:9877:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789479915.256915:0:9877:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789479915.256922:0:9877:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243d193 00010000:00080000:2.0:1789479915.256950:0:9877:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6abb2b6800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789479915.257170:0:9877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789479915.257521:0:9877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789479915.257535:0:9877:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789479915.257782:0:9877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479915.257900:0:9877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789479915.258028:0:9877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789479915.258131:0:9877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789479915.263976:0:9878:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789479915.263984:0:9878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789479915.267044:0:9877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789479915.267057:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789479915.267103:0:9877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789479915.267128:0:9877:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243d19a 00000100:00080000:1.0:1789479915.267138:0:9877:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479915.267149:0:9877:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6abb2b6800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789479915.267180:0:9877:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69810b0a80 x1876405527819136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479915.267227:0:9877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789479915.267433:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527819136:0@lo:8: 00000100:00100000:0.0:1789479915.267497:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.267555:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819136 00000100:00100000:0.0:1789479915.267561:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819136 00000100:00100000:0.0:1789479915.267589:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789479915.267596:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1876405527819136:12345-0@lo:8: 00010000:00080000:0.0:1789479915.267620:0:8493:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:0.0:1789479915.267642:0:8493:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243d1a1 00002000:00100000:0.0:1789479915.267654:0:8493:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a6987a5e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789479915.267658:0:8493:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789479915.267662:0:8493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789479915.267733:0:8493:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789479915.267941:0:8493:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789479915.267963:0:8493:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479915.268007:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527819136:12345-0@lo:8: Request processed in 410us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.268019:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789479915.268076:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0a80 x1876405527819136/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.268087:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789479915.268094:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789479915.268100:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789479915.268105:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789479915.268106:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789479915.268184:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527819264:0@lo:400: 00000100:00100000:1.0:1789479915.268236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268254:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527819776:0@lo:400: 00000100:00100000:1.0:1789479915.268269:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268281:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527820288:0@lo:400: 00000100:00100000:1.0:1789479915.268468:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268488:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789479915.268494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527819648:0@lo:400: 00000100:00100000:1.0:1789479915.268511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268533:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527820160:0@lo:400: 00000100:00100000:1.0:1789479915.268552:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268569:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527819392:0@lo:400: 00000100:00100000:1.0:1789479915.268587:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527819904:0@lo:400: 00000100:00100000:1.0:1789479915.268615:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268628:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479915.268632:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527819520:0@lo:400: 00000100:00100000:1.0:1789479915.268646:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527820032:0@lo:400: 00000100:00100000:1.0:1789479915.268666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.268698:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819264 00000100:00100000:1.0:1789479915.268702:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819264 00000100:00100000:1.0:1789479915.268722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819776 00000100:00100000:1.0:1789479915.268724:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819776 00000100:00100000:1.0:1789479915.268741:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820288 00000100:00100000:1.0:1789479915.268743:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820288 00000100:00100000:1.0:1789479915.268752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819648 00000100:00100000:1.0:1789479915.268754:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819648 00000100:00100000:1.0:1789479915.268763:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820160 00000100:00100000:1.0:1789479915.268765:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820160 00000100:00100000:1.0:1789479915.268774:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819520 00000100:00100000:1.0:1789479915.268776:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819520 00000100:00100000:1.0:1789479915.268787:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789479915.268794:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527819264:12345-0@lo:400: 00000100:00100000:1.0:1789479915.268834:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527819264:12345-0@lo:400: Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.268840:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789479915.268852:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479915.268865:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527819776:12345-0@lo:400: 00000100:00100000:1.0:1789479915.268893:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527819776:12345-0@lo:400: Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.268898:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479915.268909:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479915.268915:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527820288:12345-0@lo:400: 00000100:00100000:1.0:1789479915.268939:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527820288:12345-0@lo:400: Request processed in 24us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.268944:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479915.268953:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479915.268958:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527819648:12345-0@lo:400: 00000100:00100000:1.0:1789479915.268976:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527819648:12345-0@lo:400: Request processed in 19us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.268981:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789479915.268989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479915.268994:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527820160:12345-0@lo:400: 00000100:00100000:1.0:1789479915.269014:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527820160:12345-0@lo:400: Request processed in 21us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269019:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789479915.269129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789479915.269136:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527819520:12345-0@lo:400: 00000100:00100000:1.0:1789479915.269176:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527819520:12345-0@lo:400: Request processed in 41us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789479915.269222:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819392 00000100:00100000:1.0:1789479915.269226:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819392 00000100:00100000:1.0:1789479915.269252:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789479915.269257:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527819392:12345-0@lo:400: 00000100:00100000:1.0:1789479915.269283:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527819392:12345-0@lo:400: Request processed in 27us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269299:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789479915.269314:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527819904 00000100:00100000:1.0:1789479915.269316:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527819904 00000100:00100000:1.0:1789479915.269336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820032 00000100:00100000:1.0:1789479915.269338:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820032 00000100:00100000:1.0:1789479915.269351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479915.269356:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527819904:12345-0@lo:400: 00000100:00100000:1.0:1789479915.269380:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527819904:12345-0@lo:400: Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269385:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789479915.269393:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789479915.269398:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527820032:12345-0@lo:400: 00000100:00100000:1.0:1789479915.269414:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527820032:12345-0@lo:400: Request processed in 17us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269419:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789479915.269433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789479915.269437:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789479915.269439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789479915.269461:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e3100 x1876405527819520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269472:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527819520:0@lo:400: 00010000:00080000:1.0:1789479915.269481:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9880 x1876405527820032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269501:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527820032:0@lo:400: 00000100:00100000:1.0:1789479915.269513:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527819392:0@lo:400: 00010000:00080000:1.0:1789479915.269522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987dab480 x1876405527819904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527819904:0@lo:400: 00010000:00080000:1.0:1789479915.269559:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527819648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527819648:0@lo:400: 00010000:00080000:1.0:1789479915.269574:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987dab800 x1876405527820160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269581:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527820160:0@lo:400: 00010000:00080000:1.0:1789479915.269589:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527819264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527819264:0@lo:400: 00010000:00080000:1.0:1789479915.269603:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da8700 x1876405527819776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527819776:0@lo:400: 00010000:00080000:1.0:1789479915.269617:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987daa680 x1876405527820288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.269624:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527820288:0@lo:400: 00000020:01000000:1.0:1789479915.269707:0:9877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479915.269717:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479915.269719:0:9877:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789479915.269723:0:9877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479915.269726:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479915.269728:0:9877:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479915.269731:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479915.269733:0:9877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789479915.269758:0:9877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9877:1876405527820416:0@lo:502: 00000100:00100000:1.0:1789479915.269799:0:9877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.269823:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820416 00000100:00100000:1.0:1789479915.269827:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820416 00000100:00100000:1.0:1789479915.269852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789479915.269858:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:9877:x1876405527820416:12345-0@lo:502: 00000100:00100000:1.0:1789479915.269936:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:9877:x1876405527820416:12345-0@lo:502: Request processed in 77us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.269942:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789479915.269974:0:9877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa37209c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.269983:0:9877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9877:1876405527820416:0@lo:502: 00000020:01000000:1.0:1789479915.270002:0:9877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479915.270005:0:9877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479915.270007:0:9877:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789479915.270010:0:9877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1789479915.270939:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789479915.270971:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789479915.270981:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.270993:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479915.271003:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789479915.271006:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a83cfb000 from 39 10000000:01000000:2.0:1789479915.271008:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789479915.271153:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.271162:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.271173:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479915.271648:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527820544:0@lo:101: 00000100:00100000:2.0:1789479915.271767:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.271792:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a89cb5600 going to sleep for 11 seconds 00000004:00080000:0.0:1789479915.271884:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789479915.271893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527819136:0@lo:8: 00000004:00080000:3.0:1789479915.271963:0:9878:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789479915.272007:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527820672:0@lo:700: 00000100:00100000:1.0:1789479915.272120:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.272144:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa37209c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.272211:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820672 00000100:00100000:0.0:1789479915.272218:0:8444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820672 00000004:00080000:3.0:1789479915.272240:0:9878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 284196049337ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789479915.272247:0:9878:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789479915.272270:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479915.272278:0:8444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9879:x1876405527820672:12345-0@lo:700: 00000100:00100000:0.0:1789479915.272393:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876405527820800:0@lo:700: 00000100:00100000:0.0:1789479915.272420:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.272438:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.272759:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820800 00000100:00100000:0.0:1789479915.272764:0:6527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820800 00000100:00100000:0.0:1789479915.272794:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789479915.272800:0:6527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876405527820800:12345-0@lo:700: 00000100:00080000:1.0:1789479915.273130:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789479915.274254:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820544 00000100:00100000:2.0:1789479915.274263:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820544 00000100:00100000:2.0:1789479915.274311:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789479915.274320:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527820544:12345-0@lo:101: 00010000:00010000:2.0:1789479915.274333:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479915.274351:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d1a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.274389:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.274400:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.274410:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a600, rc 0) 00000100:00100000:2.0:1789479915.274490:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527820544:12345-0@lo:101: Request processed in 170us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.274496:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789479915.274519:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527820544:0@lo:101: 00010000:00010000:0.0:1789479915.274536:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.274546:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.274647:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527820928:0@lo:501: 00000100:00100000:0.0:1789479915.274679:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.274727:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:2.0:1789479915.274828:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527820928 00000100:00100000:2.0:1789479915.274833:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527820928 00000100:00100000:2.0:1789479915.274864:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789479915.274871:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527820928:12345-0@lo:501: 00000100:00100000:2.0:1789479915.274970:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527820928:12345-0@lo:501: Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.274977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789479915.276099:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527820928:0@lo:501: 00000100:00100000:0.0:1789479915.276142:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821056:0@lo:503: 00000100:00100000:0.0:1789479915.276212:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.276241:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.276257:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821056 00000100:00100000:0.0:1789479915.276262:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821056 00000100:00100000:0.0:1789479915.276310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789479915.276318:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527821056:12345-0@lo:503: 00000100:00100000:0.0:1789479915.276414:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527821056:12345-0@lo:503: Request processed in 96us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.276421:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789479915.276469:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821056:0@lo:503: 00000100:00100000:2.0:1789479915.277554:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9883:1876405527821184:0@lo:502: 00000100:00100000:2.0:1789479915.277601:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.277628:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff480 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.277785:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821184 00000100:00100000:0.0:1789479915.277800:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821184 00000100:00100000:0.0:1789479915.277829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789479915.277836:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:9883:x1876405527821184:12345-0@lo:502: 00000100:00100000:0.0:1789479915.277926:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:9883:x1876405527821184:12345-0@lo:502: Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.277932:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789479915.278220:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9883:1876405527821184:0@lo:502: 00000100:00100000:2.0:1789479915.278258:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9883:1876405527821312:0@lo:502: 00000100:00100000:2.0:1789479915.278285:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:2.0:1789479915.278993:0:6527:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1789479915.279416:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821312 00000100:00100000:0.0:1789479915.279423:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821312 00000100:00100000:0.0:1789479915.279465:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789479915.279473:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:9883:x1876405527821312:12345-0@lo:502: 00000100:00100000:0.0:1789479915.279576:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:9883:x1876405527821312:12345-0@lo:502: Request processed in 103us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.279583:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789479915.281257:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff480 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.281287:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9883:1876405527821312:0@lo:502: 00000040:00080000:3.0:1789479915.281326:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1789479915.281848:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1789479915.281870:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479915.281880:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.281892:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.281901:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789479915.281904:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6a83cfb000 from 6 10000000:01000000:0.0:1789479915.281906:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789479915.281933:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.281940:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.281949:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.281966:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821440:0@lo:101: 00000100:00100000:0.0:1789479915.282009:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.282899:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.282922:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821440 00000100:00100000:0.0:1789479915.282929:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821440 00000100:00100000:0.0:1789479915.282975:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789479915.282982:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527821440:12345-0@lo:101: 00010000:00010000:0.0:1789479915.282995:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.283009:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d1bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d1b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.283901:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d1b6 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.283916:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d1bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1b6 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.283926:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0c00, rc 0) 00000100:00100000:0.0:1789479915.283982:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527821440:12345-0@lo:101: Request processed in 999us (1971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.283988:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000004:00080000:0.0:1789479915.284423:0:7452:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789479915.284472:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821440:0@lo:101: 00010000:00010000:0.0:1789479915.284490:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.284500:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.284555:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821568:0@lo:256: 00000100:00100000:0.0:1789479915.284590:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.284613:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.284626:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821568 00000100:00100000:0.0:1789479915.284631:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821568 00000100:00100000:0.0:1789479915.284664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789479915.284671:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527821568:12345-0@lo:256: 20000000:01000000:0.0:1789479915.286136:0:6512:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789479915.286157:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789479915.286160:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789479915.286273:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527821568:12345-0@lo:256: Request processed in 1600us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.286283:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789479915.286838:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821568:0@lo:256: 10000000:01000000:0.0:1789479915.286885:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789479915.286894:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.286905:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.286915:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789479915.286917:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789479915.286920:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789479915.286945:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.286953:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.286962:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.286976:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821696:0@lo:101: 00000100:00100000:0.0:1789479915.287016:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.288152:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.288177:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821696 00000100:00100000:0.0:1789479915.288185:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821696 00000100:00100000:0.0:1789479915.288239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789479915.288247:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527821696:12345-0@lo:101: 00010000:00010000:0.0:1789479915.288260:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.288275:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d1c4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.288408:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.288419:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.288445:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1200, rc 0) 00000100:00100000:0.0:1789479915.288490:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527821696:12345-0@lo:101: Request processed in 243us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.288497:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789479915.288539:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821696:0@lo:101: 00010000:00010000:0.0:1789479915.288554:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.288563:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.289875:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821824:0@lo:501: 00000100:00100000:0.0:1789479915.289933:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.289965:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.290900:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821824 00000100:00100000:0.0:1789479915.290909:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821824 00000100:00100000:0.0:1789479915.290948:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789479915.290956:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527821824:12345-0@lo:501: 00000100:00100000:0.0:1789479915.291955:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527821824:12345-0@lo:501: Request processed in 997us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.291965:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789479915.292020:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821824:0@lo:501: 00000100:00100000:0.0:1789479915.292133:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821952:0@lo:503: 00000100:00100000:0.0:1789479915.292173:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.292214:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9833c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.292228:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527821952 00000100:00100000:0.0:1789479915.292232:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527821952 00000100:00100000:0.0:1789479915.292257:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789479915.292263:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527821952:12345-0@lo:503: 00000100:00100000:0.0:1789479915.293181:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527821952:12345-0@lo:503: Request processed in 914us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.293207:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789479915.293253:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527821952:0@lo:503: 00000100:00100000:0.0:1789479915.294281:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9885:1876405527822080:0@lo:502: 00000100:00100000:0.0:1789479915.294837:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.294873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822080 00000100:00100000:0.0:1789479915.294879:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822080 00000100:00100000:0.0:1789479915.294910:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789479915.294924:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:9885:x1876405527822080:12345-0@lo:502: 00000100:00100000:0.0:1789479915.295015:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:9885:x1876405527822080:12345-0@lo:502: Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.295022:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789479915.296199:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.296224:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9885:1876405527822080:0@lo:502: 00000020:01000000:0.0:1789479915.296253:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789479915.296259:0:9885:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789479915.296265:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479915.296268:0:9885:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789479915.296272:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789479915.296276:0:9885:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:0.0:1789479915.296780:0:9885:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789479915.296785:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789479915.296825:0:9885:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a6987948000) 00000020:00000080:0.0:1789479915.296851:0:9885:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1789479915.296858:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789479915.296959:0:9885:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789479915.296965:0:9885:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789479915.296971:0:9885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243d1d9 00010000:00080000:0.0:1789479915.296998:0:9885:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987527000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789479915.297252:0:9885:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1789479915.298966:0:9885:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789479915.298981:0:9885:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789479915.299125:0:6527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8444:x1876405527820800:12345-0@lo:700: Request processed in 26320us (26698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.299146:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789479915.299236:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4a300 x1876405527820800/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.299250:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8444:1876405527820800:0@lo:700: 40000000:02000000:2.0:1789479915.299261:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000040:00080000:0.0:1789479915.299981:0:9885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479915.300516:0:9885:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789479915.300976:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789479915.302954:0:9885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789479915.303965:0:9886:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789479915.303970:0:9886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:02000400:3.0:1789479915.310350:0:9884:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000080:1.0:1789479915.312656:0:9885:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789479915.312676:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789479915.313421:0:9885:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789479915.313452:0:9885:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243d1e0 00000100:00080000:1.0:1789479915.313462:0:9885:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789479915.313474:0:9885:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a6987527000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789479915.313507:0:9885:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6987dab800 x1876405527822208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789479915.314098:0:9885:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789479915.314166:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479915.314171:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479915.314173:0:9885:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789479915.314221:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479915.314226:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479915.314228:0:9885:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789479915.314244:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789479915.314247:0:9885:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789479915.314311:0:9885:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9885:1876405527822336:0@lo:502: 00000100:00100000:1.0:1789479915.314458:0:9885:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479915.314508:0:9885:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa3720180 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.315429:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527822208:0@lo:8: 00000100:00100000:1.0:1789479915.315472:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.315563:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822208 00000100:00100000:2.0:1789479915.315571:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822208 00000100:00100000:2.0:1789479915.315610:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479915.315617:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1876405527822208:12345-0@lo:8: 00010000:00080000:2.0:1789479915.315642:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 284 last 0 00000020:00000080:2.0:1789479915.315710:0:8436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243d1e7 00002000:00100000:2.0:1789479915.315723:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a6987e15000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789479915.315740:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789479915.315743:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789479915.315828:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789479915.315855:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8a6987e13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479915.315907:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527822208:12345-0@lo:8: Request processed in 289us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.315915:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789479915.315971:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987dab800 x1876405527822208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789479925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.315980:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789479915.315987:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789479915.315993:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789479915.315998:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789479915.316008:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987527000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789479915.316019:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789479915.316024:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527822208:0@lo:8: 00000004:00080000:2.0:1789479915.316062:0:9886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789479915.316114:0:9886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284239923136ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789479915.316120:0:9886:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789479915.318988:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822336 00000001:00100000:2.0:1789479915.320474:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:2.0:1789479915.320563:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789479915.320636:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822336 00000100:00100000:2.0:1789479915.320799:0:8444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527820672:12345-0@lo:700: Request processed in 48510us (48666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.320817:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789479915.320898:0:9879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987daa680 x1876405527820672/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.320912:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527820672:0@lo:700: 00000100:00100000:0.0:1789479915.321439:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789479915.321446:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:9885:x1876405527822336:12345-0@lo:502: 00000100:00100000:0.0:1789479915.321568:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:9885:x1876405527822336:12345-0@lo:502: Request processed in 121us (7122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.321575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789479915.321651:0:9885:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:9885:1876405527822336:0@lo:502: 00000020:01000000:2.0:1789479915.321676:0:9885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789479915.321691:0:9885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789479915.321693:0:9885:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789479915.321698:0:9885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1789479915.321833:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1789479915.321853:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789479915.321862:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.321873:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479915.321883:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789479915.321886:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a6a95c999c0 from 1 10000000:01000000:0.0:1789479915.321888:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789479915.321915:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.321924:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.321933:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.321961:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527822464:0@lo:101: 00000100:00100000:0.0:1789479915.321992:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.322020:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa3720180 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.322376:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822464 00000100:00100000:0.0:1789479915.322382:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822464 00000100:00100000:0.0:1789479915.322408:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789479915.322414:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527822464:12345-0@lo:101: 00010000:00010000:0.0:1789479915.322422:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479915.322434:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d1ee expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.322452:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.322461:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.322468:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81487200, rc 0) 00000100:00100000:0.0:1789479915.322497:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527822464:12345-0@lo:101: Request processed in 83us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.322503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789479915.322535:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527822464:0@lo:101: 00010000:00010000:0.0:1789479915.322547:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479915.322556:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479915.322617:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527822592:0@lo:501: 00000100:00100000:0.0:1789479915.322642:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.322660:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.322671:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822592 00000100:00100000:0.0:1789479915.322674:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822592 00000100:00100000:0.0:1789479915.322694:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789479915.322700:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527822592:12345-0@lo:501: 00000100:00100000:0.0:1789479915.322760:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527822592:12345-0@lo:501: Request processed in 59us (117us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789479915.322766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789479915.323441:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527822592:0@lo:501: 10000000:01000000:2.0:1789479915.323530:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789479915.323538:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479915.323547:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789479915.324462:0:9887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789479915.324481:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527822848:0@lo:7: 00000100:00100000:2.0:1789479915.324528:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.324551:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.324640:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527822720:0@lo:13: 00000100:00100000:0.0:1789479915.324816:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.324885:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822720 00000100:00100000:2.0:1789479915.324900:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822720 00000100:00100000:2.0:1789479915.324952:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789479915.324958:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527822720:12345-0@lo:13: 00002000:00000024:2.0:1789479915.324982:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1789479915.325020:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527822720:12345-0@lo:13: Request processed in 61us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.325025:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789479915.325141:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789479915.325166:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504700 x1876405527822720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.325182:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527822720:0@lo:13: 00000100:00100000:1.0:1789479915.325527:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822848 00000100:00100000:1.0:1789479915.325533:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822848 00000100:00100000:1.0:1789479915.325599:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789479915.325607:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9887:x1876405527822848:12345-0@lo:7: 00002000:00080000:1.0:1789479915.332811:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789479915.332821:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789479915.332900:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9887:x1876405527822848:12345-0@lo:7: Request processed in 7291us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.332919:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789479915.333162:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504380 x1876405527822848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.333175:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527822848:0@lo:7: 00000004:00080000:2.0:1789479915.333208:0:9887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789479915.333241:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527822976:0@lo:5: 00000100:00100000:2.0:1789479915.333297:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.333322:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.333554:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527822976 00000100:00100000:3.0:1789479915.333561:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527822976 00000100:00100000:3.0:1789479915.333598:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789479915.333606:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9887:x1876405527822976:12345-0@lo:5: 00002000:00080000:3.0:1789479915.333628:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789479915.333631:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789479915.338494:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527823104:0@lo:13: 00000100:00100000:1.0:1789479915.338553:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789479915.338655:0:9879:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789479915.338676:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823232:0@lo:7: 00000100:00100000:2.0:1789479915.338715:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.338732:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff780 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.338811:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823104 00000100:00100000:0.0:1789479915.338818:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823104 00000100:00100000:0.0:1789479915.338941:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479915.338950:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527823104:12345-0@lo:13: 00002000:00000024:0.0:1789479915.338968:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1789479915.339138:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527823104:12345-0@lo:13: Request processed in 189us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.339153:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789479915.339176:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823232 00000100:00100000:0.0:1789479915.339180:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823232 00000100:00100000:0.0:1789479915.339564:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789479915.339572:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527823232:12345-0@lo:7: 00000001:00080000:3.0:1789479915.341242:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789479915.341254:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789479915.341348:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9887:x1876405527822976:12345-0@lo:5: Request processed in 7740us (8058us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789479915.341358:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789479915.341407:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866fb800 x1876405527822976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.341419:0:9887:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789479915.341430:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527822976:0@lo:5: 00000004:00080000:3.0:1789479915.341443:0:9887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789479915.341482:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527823360:0@lo:700: 00000100:00100000:3.0:1789479915.341512:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.341541:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823360 00000100:00100000:3.0:1789479915.341546:0:8443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823360 00000100:00100000:3.0:1789479915.341579:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789479915.341586:0:8443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9887:x1876405527823360:12345-0@lo:700: 00000100:00100000:3.0:1789479915.341678:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0840 going to sleep for 11 seconds 00010000:00080000:1.0:1789479915.342812:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4b100 x1876405527823104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.342836:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527823104:0@lo:13: 00000100:00100000:2.0:1789479915.352853:0:8443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9887:x1876405527823360:12345-0@lo:700: Request processed in 11259us (11332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479915.352867:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789479915.353058:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dca80 x1876405527823360/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.353073:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527823360:0@lo:700: 00002000:00080000:1.0:1789479915.356568:0:8493:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789479915.356576:0:8493:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789479915.356655:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527823232:12345-0@lo:7: Request processed in 17081us (17935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.356665:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789479915.356828:0:9879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669f480 x1876405527823232/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479915.356842:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823232:0@lo:7: 00000004:00080000:3.0:1789479915.356854:0:9879:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789479915.356888:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823488:0@lo:5: 00000100:00100000:3.0:1789479915.356919:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479915.357993:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789479915.358058:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823488 00000100:00100000:0.0:1789479915.358066:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823488 00000100:00100000:0.0:1789479915.358115:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789479915.358125:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527823488:12345-0@lo:5: 00002000:00080000:0.0:1789479915.358149:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789479915.358213:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527823488:12345-0@lo:5: Request processed in 90us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479915.358219:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:02000040:0.0:1789479915.358245:0:9887:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00010000:00080000:2.0:1789479915.358426:0:9879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5ded80 x1876405527823488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.358438:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823488:0@lo:5: 00000004:00080000:2.0:1789479915.358447:0:9879:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789479915.358492:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823616:0@lo:5: 00000100:00100000:2.0:1789479915.358522:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.358542:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff780 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.358592:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823616 00000100:00100000:3.0:1789479915.358596:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823616 00000100:00100000:3.0:1789479915.358622:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479915.358630:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9879:x1876405527823616:12345-0@lo:5: 00002000:00080000:3.0:1789479915.358652:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789479915.360158:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9879:x1876405527823616:12345-0@lo:5: Request processed in 1525us (1631us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789479915.360167:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789479915.360506:0:9879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669ca80 x1876405527823616/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479915.360522:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9879:1876405527823616:0@lo:5: 00000004:00080000:2.0:1789479915.360535:0:9879:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789479915.360568:0:9879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9879:1876405527823744:0@lo:900: 00000100:00100000:2.0:1789479915.360610:0:9879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479915.360640:0:9879:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1789479915.366988:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823744 00000100:00100000:1.0:1789479915.367005:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823744 00000100:00100000:1.0:1789479915.367087:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789479915.367097:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9879:x1876405527823744:12345-0@lo:900: 00000100:00100000:1.0:1789479915.367221:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9879:x1876405527823744:12345-0@lo:900: Request processed in 125us (6610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479915.367228:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789479915.367269:0:9879:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669f480 x1876405527823744/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479915.367284:0:9879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9879:1876405527823744:0@lo:900: 00000100:00100000:0.0:1789479915.370906:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527823872:0@lo:5: 00000100:00100000:0.0:1789479915.370967:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479915.371062:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aafb3f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789479915.377918:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527823872 00000100:00100000:3.0:1789479915.377945:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527823872 00000100:00100000:3.0:1789479915.379332:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789479915.379347:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9887:x1876405527823872:12345-0@lo:5: 00002000:00080000:3.0:1789479915.389408:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789479915.389429:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1789479915.396005:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9887:x1876405527823872:12345-0@lo:5: Request processed in 16653us (25029us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789479915.396019:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789479915.397639:0:9887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d49500 x1876405527823872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789479931 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479915.397658:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9887:1876405527823872:0@lo:5: 00000004:00080000:0.0:1789479915.397674:0:9887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1789479915.845459:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789479916.614679:0:9940:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789479916.614966:0:9940:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789479916.869285:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789479917.356580:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789479917.356597:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789479917.764592:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527824000:0@lo:13: 00000100:00100000:1.0:1789479917.764655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479917.764909:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479917.764918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527824128:0@lo:13: 00000100:00100000:1.0:1789479917.764958:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479917.765043:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824000 00000100:00100000:0.0:1789479917.765052:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824000 00000100:00100000:0.0:1789479917.765101:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824128 00000100:00100000:0.0:1789479917.765104:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824128 00000100:00100000:0.0:1789479917.765121:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479917.765129:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527824000:12345-0@lo:13: 00002000:00000024:0.0:1789479917.765159:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479917.765222:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527824000:12345-0@lo:13: Request processed in 94us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479917.765239:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789479917.765255:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789479917.765262:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527824128:12345-0@lo:13: 00002000:00000024:0.0:1789479917.765271:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479917.765296:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527824128:12345-0@lo:13: Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479917.765301:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789479917.765501:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789479917.765530:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d49180 x1876405527824128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479917.765547:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527824128:0@lo:13: 00010000:00080000:1.0:1789479917.765559:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4ca80 x1876405527824000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479917.765569:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527824000:0@lo:13: 00010000:00010000:0.0:1789479917.892580:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479918.279563:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527824256:0@lo:41: 00000100:00100000:2.0:1789479918.279632:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479918.282151:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824256 00000100:00100000:1.0:1789479918.282164:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824256 00000100:00100000:1.0:1789479918.282241:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479918.282253:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527824256:12345-0@lo:41: 00000004:00000024:1.0:1789479918.282287:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789479918.282417:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527824256:12345-0@lo:41: Request processed in 168us (2785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479918.282425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789479918.282677:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527824256:0@lo:41: 00010000:00010000:0.0:1789479918.917638:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789479919.317250:0:10041:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789479919.317489:0:10041:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789479919.943417:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789479920.174173:0:10089:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789479920.174183:0:10089:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789479920.326737:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527824512:0@lo:400: 00000100:00100000:1.0:1789479920.326809:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.326950:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527825024:0@lo:400: 00000100:00100000:1.0:1789479920.326972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.326993:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527825536:0@lo:400: 00000100:00100000:1.0:1789479920.327021:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.327047:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789479920.327053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527824640:0@lo:400: 00000100:00100000:1.0:1789479920.327084:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.327100:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527825152:0@lo:400: 00000100:00100000:1.0:1789479920.327115:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.327127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527825664:0@lo:400: 00000100:00100000:1.0:1789479920.327142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479920.327164:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824512 00000100:00100000:1.0:1789479920.327170:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824512 00000100:00100000:1.0:1789479920.327224:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825024 00000100:00100000:1.0:1789479920.327228:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825024 00000100:00100000:1.0:1789479920.327248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825536 00000100:00100000:1.0:1789479920.327251:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825536 00000100:00100000:1.0:1789479920.327262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825152 00000100:00100000:1.0:1789479920.327264:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825152 00000100:00100000:1.0:1789479920.327274:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825664 00000100:00100000:1.0:1789479920.327276:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825664 00000100:00100000:1.0:1789479920.327289:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789479920.327297:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527824512:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327345:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527824512:12345-0@lo:400: Request processed in 48us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327351:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789479920.327367:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789479920.327373:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527825024:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327398:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527825024:12345-0@lo:400: Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327403:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789479920.327414:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789479920.327421:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527825536:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327445:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527825536:12345-0@lo:400: Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327457:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789479920.327739:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479920.327755:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789479920.327773:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527825152:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327804:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527825152:12345-0@lo:400: Request processed in 42us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327809:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789479920.327831:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789479920.327837:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527825664:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327864:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527825664:12345-0@lo:400: Request processed in 28us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327869:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789479920.327893:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824640 00000100:00100000:1.0:1789479920.327897:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824640 00000100:00100000:1.0:1789479920.327923:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789479920.327928:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527824640:12345-0@lo:400: 00000100:00100000:1.0:1789479920.327955:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527824640:12345-0@lo:400: Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.327960:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1789479920.327976:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789479920.327979:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479920.328001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527824640:0@lo:400: 00010000:00080000:1.0:1789479920.328025:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527825152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479920.328034:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527825152:0@lo:400: 00010000:00080000:1.0:1789479920.328043:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd500 x1876405527825664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479920.328057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527825664:0@lo:400: 00010000:00080000:1.0:1789479920.328069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987dab480 x1876405527824512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479920.328076:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527824512:0@lo:400: 00010000:00080000:1.0:1789479920.328084:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0a80 x1876405527825024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479920.328092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527825024:0@lo:400: 00010000:00080000:1.0:1789479920.328099:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e3100 x1876405527825536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479920.328106:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527825536:0@lo:400: 00000100:00100000:2.0:1789479920.329688:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527824768:0@lo:400: 00000100:00100000:2.0:1789479920.329741:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.329783:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527825280:0@lo:400: 00000100:00100000:2.0:1789479920.329806:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.329828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527825792:0@lo:400: 00000100:00100000:2.0:1789479920.329850:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.329875:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789479920.329883:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527824384:0@lo:400: 00000100:00100000:2.0:1789479920.329918:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.329941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527824896:0@lo:400: 00000100:00100000:2.0:1789479920.329962:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.329980:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527825408:0@lo:400: 00000100:00100000:2.0:1789479920.329997:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.330029:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527825920:0@lo:400: 00000100:00100000:2.0:1789479920.330048:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.330078:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824768 00000100:00100000:2.0:1789479920.330084:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824768 00000100:00100000:2.0:1789479920.330118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789479920.330125:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527824768:12345-0@lo:400: 00000100:00100000:2.0:1789479920.330169:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527824768:12345-0@lo:400: Request processed in 44us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.330176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789479920.330210:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825280 00000100:00100000:2.0:1789479920.330213:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825280 00000100:00100000:2.0:1789479920.330238:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825792 00000100:00100000:2.0:1789479920.330241:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825792 00000100:00100000:2.0:1789479920.330252:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825408 00000100:00100000:2.0:1789479920.330255:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825408 00000100:00100000:2.0:1789479920.330265:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527825920 00000100:00100000:2.0:1789479920.330267:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527825920 00000100:00100000:2.0:1789479920.330278:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479920.330284:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527825280:12345-0@lo:400: 00000100:00100000:2.0:1789479920.330313:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527825280:12345-0@lo:400: Request processed in 29us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.330318:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789479920.330328:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479920.330340:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527825792:12345-0@lo:400: 00000100:00100000:2.0:1789479920.330363:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527825792:12345-0@lo:400: Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.330368:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789479920.330379:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479920.330383:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527825408:12345-0@lo:400: 00000100:00100000:2.0:1789479920.330403:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527825408:12345-0@lo:400: Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.330408:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789479920.330416:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789479920.330421:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527825920:12345-0@lo:400: 00000100:00100000:2.0:1789479920.330440:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527825920:12345-0@lo:400: Request processed in 20us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.330445:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789479920.331018:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824896 00000100:00100000:2.0:1789479920.331025:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824896 00000100:00100000:2.0:1789479920.331069:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789479920.331076:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527824896:12345-0@lo:400: 00000100:00100000:2.0:1789479920.331111:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527824896:12345-0@lo:400: Request processed in 36us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.331116:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789479920.331143:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479920.331147:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479920.331173:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527824896:0@lo:400: 00010000:00080000:2.0:1789479920.331184:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527825408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.331227:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527825408:0@lo:400: 00010000:00080000:2.0:1789479920.331240:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd180 x1876405527825920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.331247:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1789479920.331258:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527825920:0@lo:400: 00010000:00080000:2.0:1789479920.331267:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987dab800 x1876405527824768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.331274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527824768:0@lo:400: 00010000:00080000:2.0:1789479920.331283:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b2300 x1876405527825280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.331289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527825280:0@lo:400: 00010000:00080000:2.0:1789479920.331297:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbc380 x1876405527825792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479920.331303:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789479920.331311:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527825792:0@lo:400: 00000100:00100000:0.0:1789479920.334604:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527826048:0@lo:41: 00000100:00100000:0.0:1789479920.334671:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479920.334728:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527824384 00000100:00100000:0.0:1789479920.334735:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527824384 00000100:00100000:0.0:1789479920.334795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789479920.334804:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527824384:12345-0@lo:400: 00000100:00100000:0.0:1789479920.335030:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527824384:12345-0@lo:400: Request processed in 226us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.335044:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789479920.335097:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527824384:0@lo:400: 00000100:00100000:1.0:1789479920.335208:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826048 00000100:00100000:1.0:1789479920.335212:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826048 00000100:00100000:1.0:1789479920.335239:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789479920.335246:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527826048:12345-0@lo:41: 00000004:00000024:1.0:1789479920.335271:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789479920.335310:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527826048:12345-0@lo:41: Request processed in 64us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.335316:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789479920.336257:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527826048:0@lo:41: 00000100:00100000:1.0:1789479920.696987:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479920.697104:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507850368 00000100:00100000:0.0:1789479920.697117:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507850368 00000100:00100000:0.0:1789479920.697175:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:0.0:1789479920.697185:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1876405507850368:12345-192.168.206.44@tcp:250: 00010000:00080000:0.0:1789479920.697244:0:6512:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 9d3d8ec2-b7ed-481f-86df-876452d4dcf6@192.168.206.44@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:0.0:1789479920.697280:0:6512:0:(genops.c:1384:class_connect()) connect: client 9d3d8ec2-b7ed-481f-86df-876452d4dcf6, cookie 0xdaa289fda243d1fc 00000100:00080000:0.0:1789479920.697464:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8a6987e52800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479920.697546:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+5:2398:x1876405507850368:12345-192.168.206.44@tcp:250: Request processed in 360us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.697553:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:1.0:1789479920.702597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479920.702758:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507850496 00000100:00100000:3.0:1789479920.703053:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507850496 00000100:00100000:3.0:1789479920.703127:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:3.0:1789479920.703138:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+5:6168:x1876405507850496:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1789479920.703161:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479920.703185:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d295e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.703252:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.703266:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.703277:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7c00, rc 0) 00000100:00100000:3.0:1789479920.703346:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+6:6168:x1876405507850496:12345-192.168.206.44@tcp:101: Request processed in 210us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479920.703353:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:0.0:1789479920.719894:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479920.720232:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507850624 00000100:00100000:1.0:1789479920.720245:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507850624 00000100:00100000:1.0:1789479920.720310:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:1.0:1789479920.720322:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+6:6168:x1876405507850624:12345-192.168.206.44@tcp:501: 00000100:00100000:1.0:1789479920.720513:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+6:6168:x1876405507850624:12345-192.168.206.44@tcp:501: Request processed in 192us (629us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789479920.720522:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:2.0:1789479920.730598:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479920.730882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507850752 00000100:00100000:3.0:1789479920.730921:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507850752 00000100:00100000:3.0:1789479920.731085:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1789479920.731112:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+6:6168:x1876405507850752:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1789479920.731131:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479920.731158:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2965 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.733806:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.733834:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479920.733845:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7800, rc 0) 00000100:00100000:2.0:1789479920.734403:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+7:6168:x1876405507850752:12345-192.168.206.44@tcp:101: Request processed in 3299us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.734414:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:2.0:1789479920.740118:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479920.740232:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507850880 00000100:00100000:0.0:1789479920.740251:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507850880 00000100:00100000:0.0:1789479920.740292:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:0.0:1789479920.740301:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+7:6168:x1876405507850880:12345-192.168.206.44@tcp:501: 00000100:00100000:0.0:1789479920.740434:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6168:x1876405507850880:12345-192.168.206.44@tcp:501: Request processed in 134us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.740550:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:0.0:1789479920.744428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.744633:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851008 00000100:00100000:2.0:1789479920.744643:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851008 00000100:00100000:2.0:1789479920.744691:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:2.0:1789479920.744713:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6168:x1876405507851008:12345-192.168.206.44@tcp:503: 00000100:00100000:2.0:1789479920.744896:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6168:x1876405507851008:12345-192.168.206.44@tcp:503: Request processed in 184us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.744904:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:2.0:1789479920.757187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479920.757338:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851136 00000100:00100000:1.0:1789479920.757348:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851136 00000100:00100000:1.0:1789479920.757400:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:1.0:1789479920.757409:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6186:x1876405507851136:12345-192.168.206.44@tcp:502: 00000100:00100000:1.0:1789479920.757666:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6186:x1876405507851136:12345-192.168.206.44@tcp:502: Request processed in 257us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479920.757674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:1.0:1789479920.775614:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479920.775858:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851264 00000100:00100000:0.0:1789479920.775870:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851264 00000100:00100000:0.0:1789479920.775938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:0.0:1789479920.775969:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6186:x1876405507851264:12345-192.168.206.44@tcp:502: 00000100:00100000:0.0:1789479920.776239:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6186:x1876405507851264:12345-192.168.206.44@tcp:502: Request processed in 220us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.776250:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:0.0:1789479920.786142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.786258:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851392 00000100:00100000:2.0:1789479920.786273:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851392 00000100:00100000:2.0:1789479920.786343:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:2.0:1789479920.786354:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6168:x1876405507851392:12345-192.168.206.44@tcp:101: 00010000:00010000:2.0:1789479920.786371:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479920.786391:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243d211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2996 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.786432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243d211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2996 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.786570:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243d211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2996 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.786579:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047ba00, rc 0) 00000100:00100000:2.0:1789479920.786642:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6168:x1876405507851392:12345-192.168.206.44@tcp:101: Request processed in 290us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.786649:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:2.0:1789479920.791029:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479920.791167:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851520 00000100:00100000:1.0:1789479920.791179:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851520 00000100:00100000:1.0:1789479920.791278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:0.0:1789479920.791328:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6168:x1876405507851520:12345-192.168.206.44@tcp:256: 20000000:01000000:0.0:1789479920.791369:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789479920.791410:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789479920.791413:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789479920.791416:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789479920.791418:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789479920.791420:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789479920.793782:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6168:x1876405507851520:12345-192.168.206.44@tcp:256: Request processed in 2469us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.793802:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:1.0:1789479920.796629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.796805:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851648 00000100:00100000:2.0:1789479920.796818:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851648 00000100:00100000:2.0:1789479920.796888:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:2.0:1789479920.796900:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6168:x1876405507851648:12345-192.168.206.44@tcp:101: 00010000:00010000:2.0:1789479920.796938:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479920.796962:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d299d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.797095:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.797112:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479920.797123:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789479920.797301:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6168:x1876405507851648:12345-192.168.206.44@tcp:101: Request processed in 401us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.797310:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:2.0:1789479920.802721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479920.803169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851776 00000100:00100000:0.0:1789479920.803183:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851776 00000100:00100000:0.0:1789479920.803292:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:0.0:1789479920.803304:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6168:x1876405507851776:12345-192.168.206.44@tcp:501: 00000100:00100000:0.0:1789479920.803574:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6168:x1876405507851776:12345-192.168.206.44@tcp:501: Request processed in 271us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.803582:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:1.0:1789479920.806281:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.806409:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507851904 00000100:00100000:2.0:1789479920.806423:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507851904 00000100:00100000:2.0:1789479920.806481:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:2.0:1789479920.806494:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6168:x1876405507851904:12345-192.168.206.44@tcp:503: 00000100:00100000:2.0:1789479920.806695:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6168:x1876405507851904:12345-192.168.206.44@tcp:503: Request processed in 203us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.806704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:1.0:1789479920.811183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.811667:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852032 00000100:00100000:2.0:1789479920.811680:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852032 00000100:00100000:2.0:1789479920.811752:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:2.0:1789479920.811861:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6191:x1876405507852032:12345-192.168.206.44@tcp:502: 00000100:00100000:2.0:1789479920.812078:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6191:x1876405507852032:12345-192.168.206.44@tcp:502: Request processed in 315us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.812093:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:3.0:1789479920.815382:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479920.815556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852160 00000100:00100000:0.0:1789479920.815569:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852160 00000100:00100000:0.0:1789479920.815645:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:0.0:1789479920.815957:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6191:x1876405507852160:12345-192.168.206.44@tcp:502: 00000100:00100000:0.0:1789479920.816299:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6191:x1876405507852160:12345-192.168.206.44@tcp:502: Request processed in 349us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479920.816309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:1.0:1789479920.824884:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.825070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852288 00000100:00100000:2.0:1789479920.825082:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852288 00000100:00100000:2.0:1789479920.825138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789479920.825148:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876405507852288:12345-192.168.206.44@tcp:38: 00010000:00080000:2.0:1789479920.825186:0:6522:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1789479920.825294:0:6522:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d21f 00000004:00100000:2.0:1789479920.825326:0:6522:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789479920.825622:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8a6987e12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479920.825719:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507852288:12345-192.168.206.44@tcp:38: Request processed in 571us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.825728:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1789479920.828308:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479920.828483:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852544 00000100:00100000:2.0:1789479920.828497:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852544 00000100:00100000:2.0:1789479920.828598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:2.0:1789479920.828610:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1876405507852544:12345-192.168.206.44@tcp:38: 00010000:00080000:2.0:1789479920.828652:0:6520:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1789479920.828726:0:6520:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d226 00000004:00100000:2.0:1789479920.828758:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789479920.829493:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8a6987e16000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479920.829591:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507852544:12345-192.168.206.44@tcp:38: Request processed in 981us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.829600:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:2.0:1789479920.836965:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479920.837002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527826176:0@lo:13: 00000100:00100000:2.0:1789479920.837150:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479920.837253:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527826304:0@lo:13: 00000100:00100000:3.0:1789479920.837290:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479920.837413:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826176 00000100:00100000:2.0:1789479920.837432:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826176 00000100:00100000:2.0:1789479920.837477:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826304 00000100:00100000:2.0:1789479920.837480:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826304 00000100:00100000:2.0:1789479920.837496:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479920.837505:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527826176:12345-0@lo:13: 00002000:00000024:2.0:1789479920.837550:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479920.837609:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527826176:12345-0@lo:13: Request processed in 104us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.837616:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789479920.837633:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789479920.837638:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527826304:12345-0@lo:13: 00002000:00000024:2.0:1789479920.837647:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789479920.837812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbe680 x1876405527826176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479920.838076:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527826176:0@lo:13: 00000100:00100000:2.0:1789479920.838652:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527826304:12345-0@lo:13: Request processed in 1011us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479920.838661:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789479920.840456:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbed80 x1876405527826304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479920.840487:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527826304:0@lo:13: 00010000:00010000:0.0:1789479920.964623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479921.837175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479921.837358:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852800 00000100:00100000:1.0:1789479921.837382:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852800 00000100:00100000:1.0:1789479921.837477:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:1.0:1789479921.837491:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507852800:12345-192.168.206.44@tcp:41: 00000004:00000024:1.0:1789479921.837541:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789479921.837631:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507852800:12345-192.168.206.44@tcp:41: Request processed in 144us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479921.837659:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00080000:2.0:1789479921.838336:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479921.839558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479921.839605:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479921.839693:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852672 00000100:00100000:2.0:1789479921.839704:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852672 00000100:00100000:2.0:1789479921.839803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852416 00000100:00100000:2.0:1789479921.839806:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852416 00000100:00100000:2.0:1789479921.839830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1789479921.839840:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507852672:12345-192.168.206.44@tcp:41: 00000004:00000024:2.0:1789479921.839884:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789479921.840043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789479921.840055:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507852416:12345-192.168.206.44@tcp:41: 00000004:00000024:0.0:1789479921.840077:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789479921.840156:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507852416:12345-192.168.206.44@tcp:41: Request processed in 103us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479921.840163:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1789479921.840624:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507852672:12345-192.168.206.44@tcp:41: Request processed in 783us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.840660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:3.0:1789479921.840801:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789479921.842594:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479921.843122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507852928 00000100:00100000:0.0:1789479921.843136:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507852928 00000100:00100000:0.0:1789479921.843248:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1789479921.843260:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507852928:12345-192.168.206.44@tcp:40: 00000100:00100000:0.0:1789479921.843384:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507852928:12345-192.168.206.44@tcp:40: Request processed in 113us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479921.843392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1789479921.848071:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479921.848172:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479921.848311:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853056 00000100:00100000:2.0:1789479921.848324:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853056 00000100:00100000:3.0:1789479921.848465:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1789479921.848476:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876405507853056:12345-192.168.206.44@tcp:8: 00010000:00080000:3.0:1789479921.848516:0:8493:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:3.0:1789479921.848555:0:8493:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d22d 00002000:00100000:3.0:1789479921.848570:0:8493:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7386f76-6ebd-4087-bc50-a71a216590e4/ffff8a6985dae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789479921.848595:0:8493:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789479921.848823:0:8493:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789479921.848860:0:8493:0:(import.c:65:import_set_state_nolock()) ffff8a6985dae800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789479921.849367:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853312 00000100:00100000:1.0:1789479921.849391:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853312 00000100:00100000:1.0:1789479921.849451:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1789479921.849461:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507853312:12345-192.168.206.44@tcp:900: 00000100:00100000:3.0:1789479921.850074:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507853056:12345-192.168.206.44@tcp:8: Request processed in 1594us (1896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479921.850085:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1789479921.852959:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479921.853044:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479921.853058:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853184 00000100:00100000:2.0:1789479921.853071:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853184 00000100:00100000:2.0:1789479921.853123:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1789479921.853133:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1876405507853184:12345-192.168.206.44@tcp:8: 00010000:00080000:2.0:1789479921.853222:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:2.0:1789479921.853261:0:8435:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d234 00002000:00100000:2.0:1789479921.853274:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7386f76-6ebd-4087-bc50-a71a216590e4/ffff8a6987e14800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789479921.853287:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789479921.853518:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789479921.853556:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6987e13000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789479921.853644:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507853184:12345-192.168.206.44@tcp:8: Request processed in 511us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479921.853652:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1789479921.853798:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853440 00000100:00100000:3.0:1789479921.853805:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853440 00000100:00100000:3.0:1789479921.853849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:3.0:1789479921.853858:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507853440:12345-192.168.206.44@tcp:400: 00000100:00100000:3.0:1789479921.853891:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507853440:12345-192.168.206.44@tcp:400: Request processed in 35us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479921.853897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:1.0:1789479921.858539:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507853312:12345-192.168.206.44@tcp:900: Request processed in 9064us (10467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479921.858556:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:0.0:1789479921.861120:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479921.862452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853568 00000100:00100000:2.0:1789479921.862469:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853568 00000100:00100000:2.0:1789479921.862544:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789479921.862555:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507853568:12345-192.168.206.44@tcp:33: 00000004:00080000:0.0:1789479921.890147:0:6523:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27489us 00000004:00200000:0.0:1789479921.913908:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789479921.914086:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6168:x1876405507853568:12345-192.168.206.44@tcp:33: Request processed in 51523us (52969us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479921.914113:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00010000:00010000:0.0:1789479921.988902:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479922.085899:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479922.088551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853696 00000100:00100000:3.0:1789479922.088566:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853696 00000100:00100000:3.0:1789479922.088648:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1789479922.088658:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6209:x1876405507853696:12345-192.168.206.44@tcp:101: 00010000:00010000:3.0:1789479922.088676:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479922.088729:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6000/0xdaa289fda243d23b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d29ce expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088809:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088823:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088836:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789479922.088880:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789479922.088884:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789479922.088899:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6000/0xdaa289fda243d23b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ce expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088940:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ce expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479922.088948:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a97c2e500) 00010000:00010000:3.0:1789479922.088951:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789479922.088955:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6a00, rc 0) 00000100:00100000:3.0:1789479922.089024:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:6209:x1876405507853696:12345-192.168.206.44@tcp:101: Request processed in 367us (3138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479922.089031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1789479922.884751:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527826432:0@lo:13: 00000100:00100000:3.0:1789479922.884819:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479922.884919:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479922.884934:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527826560:0@lo:13: 00000100:00100000:0.0:1789479922.884963:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479922.885014:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826432 00000100:00100000:0.0:1789479922.885021:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826432 00000100:00100000:0.0:1789479922.885063:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826560 00000100:00100000:0.0:1789479922.885066:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826560 00000100:00100000:0.0:1789479922.885084:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789479922.885092:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527826432:12345-0@lo:13: 00002000:00000024:0.0:1789479922.885113:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479922.885181:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527826432:12345-0@lo:13: Request processed in 89us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479922.885206:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789479922.885223:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789479922.885230:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527826560:12345-0@lo:13: 00002000:00000024:0.0:1789479922.885239:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479922.885268:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527826560:12345-0@lo:13: Request processed in 39us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479922.885274:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789479922.885312:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4c700 x1876405527826560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789479922.885326:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4a300 x1876405527826432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479922.885329:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527826560:0@lo:13: 00000100:00100000:3.0:1789479922.885337:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527826432:0@lo:13: 00000100:00080000:1.0:1789479922.885350:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789479923.012338:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479923.400351:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479923.400374:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527826688:0@lo:41: 00000100:00100000:3.0:1789479923.400436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479923.400520:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826688 00000100:00100000:2.0:1789479923.400528:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826688 00000100:00100000:2.0:1789479923.400578:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789479923.400587:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527826688:12345-0@lo:41: 00000004:00000024:2.0:1789479923.400631:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789479923.400675:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527826688:12345-0@lo:41: Request processed in 90us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479923.400682:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479923.400829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527826688:0@lo:41: 00010000:00010000:0.0:1789479924.036533:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479924.433696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479924.433952:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853824 00000100:00100000:0.0:1789479924.433964:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853824 00000100:00100000:0.0:1789479924.434062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:0.0:1789479924.434074:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:6261:x1876405507853824:12345-192.168.206.44@tcp:41: 00000004:00000024:0.0:1789479924.434126:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789479924.434407:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:6261:x1876405507853824:12345-192.168.206.44@tcp:41: Request processed in 334us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479924.434416:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00080000:1.0:1789479924.434641:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479924.439767:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479924.439981:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507853952 00000100:00100000:3.0:1789479924.440003:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507853952 00000100:00100000:3.0:1789479924.440098:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1789479924.440110:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507853952:12345-192.168.206.44@tcp:41: 00000004:00000024:3.0:1789479924.440159:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479924.440267:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507853952:12345-192.168.206.44@tcp:41: Request processed in 159us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479924.440275:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:1.0:1789479924.440487:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789479924.448321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479924.448388:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854080 00000100:00100000:0.0:1789479924.448399:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854080 00000100:00100000:0.0:1789479924.448471:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:0.0:1789479924.448482:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507854080:12345-192.168.206.44@tcp:13: 00002000:00000024:0.0:1789479924.448549:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479924.448616:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507854080:12345-192.168.206.44@tcp:13: Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479924.448624:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00080000:1.0:1789479924.448696:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479924.451901:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479924.452563:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854208 00000100:00100000:2.0:1789479924.452573:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854208 00000100:00100000:2.0:1789479924.452646:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00080000:1.0:1789479924.452657:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789479924.452658:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507854208:12345-192.168.206.44@tcp:13: 00002000:00000024:2.0:1789479924.452693:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479924.452914:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f7386f76-6ebd-4087-bc50-a71a216590e4+6:6261:x1876405507854208:12345-192.168.206.44@tcp:13: Request processed in 202us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479924.452923:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00010000:00010000:0.0:1789479925.064708:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479925.444623:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527826944:0@lo:400: 00000100:00100000:3.0:1789479925.444724:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.444887:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527827456:0@lo:400: 00000100:00100000:3.0:1789479925.444912:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.444936:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527827968:0@lo:400: 00000100:00100000:3.0:1789479925.444970:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445024:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789479925.445031:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527826816:0@lo:400: 00000100:00100000:3.0:1789479925.445069:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445090:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527827328:0@lo:400: 00000100:00100000:3.0:1789479925.445134:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445155:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527827840:0@lo:400: 00000100:00100000:3.0:1789479925.445180:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445227:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527828352:0@lo:400: 00000100:00100000:3.0:1789479925.445248:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527827072:0@lo:400: 00000100:00100000:3.0:1789479925.445295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527827584:0@lo:400: 00000100:00100000:3.0:1789479925.445330:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527828096:0@lo:400: 00000100:00100000:3.0:1789479925.445379:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445393:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789479925.445400:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527827200:0@lo:400: 00000100:00100000:3.0:1789479925.445418:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445431:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527827712:0@lo:400: 00000100:00100000:3.0:1789479925.445457:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445477:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527828224:0@lo:400: 00000100:00100000:3.0:1789479925.445497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.445527:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826944 00000100:00100000:3.0:1789479925.445534:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826944 00000100:00100000:3.0:1789479925.445564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827456 00000100:00100000:3.0:1789479925.445567:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827456 00000100:00100000:0.0:1789479925.445868:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527826816 00000100:00100000:0.0:1789479925.445873:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527826816 00000100:00100000:3.0:1789479925.445968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827968 00000100:00100000:3.0:1789479925.445972:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827968 00000100:00100000:3.0:1789479925.446004:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827584 00000100:00100000:3.0:1789479925.446008:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827584 00000100:00100000:3.0:1789479925.446018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828096 00000100:00100000:3.0:1789479925.446020:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828096 00000100:00100000:3.0:1789479925.446029:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827200 00000100:00100000:3.0:1789479925.446031:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827200 00000100:00100000:3.0:1789479925.446043:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789479925.446050:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527826944:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446093:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527826944:12345-0@lo:400: Request processed in 43us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789479925.446113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789479925.446119:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527827456:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446142:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527827456:12345-0@lo:400: Request processed in 24us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789479925.446157:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789479925.446162:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527827968:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446183:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527827968:12345-0@lo:400: Request processed in 21us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789479925.446217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789479925.446223:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527827584:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446255:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527827584:12345-0@lo:400: Request processed in 32us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446260:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789479925.446270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789479925.446276:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527828096:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446306:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527828096:12345-0@lo:400: Request processed in 31us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789479925.446322:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789479925.446327:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527827200:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446349:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527827200:12345-0@lo:400: Request processed in 22us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446354:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789479925.446377:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827328 00000100:00100000:3.0:1789479925.446380:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827328 00000100:00100000:3.0:1789479925.446399:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827072 00000100:00100000:3.0:1789479925.446401:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827072 00000100:00100000:3.0:1789479925.446412:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479925.446417:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527827328:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446446:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527827328:12345-0@lo:400: Request processed in 29us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446451:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479925.446462:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789479925.446467:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527827072:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446505:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527827072:12345-0@lo:400: Request processed in 38us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789479925.446529:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827840 00000100:00100000:3.0:1789479925.446532:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827840 00000100:00100000:3.0:1789479925.446550:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828352 00000100:00100000:3.0:1789479925.446553:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828352 00000100:00100000:3.0:1789479925.446566:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527827712 00000100:00100000:3.0:1789479925.446569:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527827712 00000100:00100000:2.0:1789479925.446582:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527827200:0@lo:400: 00000100:00100000:2.0:1789479925.446598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527827072:0@lo:400: 00000100:00100000:3.0:1789479925.446605:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828224 00000100:00100000:3.0:1789479925.446609:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828224 00010000:00080000:2.0:1789479925.446619:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0df80 x1876405527827584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.446626:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789479925.446637:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527827840:12345-0@lo:400: 00000100:00100000:2.0:1789479925.446637:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527827584:0@lo:400: 00010000:00080000:2.0:1789479925.446671:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0f480 x1876405527828096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.446673:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527827840:12345-0@lo:400: Request processed in 38us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.446688:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789479925.446693:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527828096:0@lo:400: 00000100:00100000:3.0:1789479925.446701:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479925.446709:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527828352:12345-0@lo:400: 00000100:00100000:3.0:1789479925.446734:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527828352:12345-0@lo:400: Request processed in 26us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.446840:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789479925.446850:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527828480:0@lo:41: 00000100:00100000:1.0:1789479925.446879:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479925.446920:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828480 00000100:00100000:2.0:1789479925.446924:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828480 00000100:00100000:2.0:1789479925.446960:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789479925.446964:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527828480:12345-0@lo:41: 00000004:00000024:2.0:1789479925.447005:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479925.447041:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527828480:12345-0@lo:41: Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479925.447047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789479925.447163:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527828480:0@lo:41: 00000100:00100000:3.0:1789479925.450316:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789479925.450358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479925.450370:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527827712:12345-0@lo:400: 00000100:00100000:0.0:1789479925.451999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789479925.452017:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527826816:12345-0@lo:400: 00000100:00100000:0.0:1789479925.452080:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527826816:12345-0@lo:400: Request processed in 71us (7010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479925.452087:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789479925.454511:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527827712:12345-0@lo:400: Request processed in 4137us (9043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.454525:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789479925.454554:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789479925.454567:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527828224:12345-0@lo:400: 00000100:00100000:3.0:1789479925.454635:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527828224:12345-0@lo:400: Request processed in 74us (9137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479925.454642:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789479925.454681:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479925.454686:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479925.454690:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479925.454692:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479925.454725:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527826816:0@lo:400: 00000100:00100000:3.0:1789479925.454765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527827328:0@lo:400: 00010000:00080000:3.0:1789479925.454779:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0fb80 x1876405527827840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.454791:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527827840:0@lo:400: 00010000:00080000:3.0:1789479925.454801:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0f800 x1876405527828352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.454810:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527828352:0@lo:400: 00000100:00100000:3.0:1789479925.454823:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527826944:0@lo:400: 00000100:00100000:3.0:1789479925.454834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527827456:0@lo:400: 00000100:00100000:3.0:1789479925.454848:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527827968:0@lo:400: 00010000:00080000:2.0:1789479925.454893:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0ce00 x1876405527827712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479925.454906:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527827712:0@lo:400: 00010000:00080000:2.0:1789479925.454918:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0d880 x1876405527828224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479925.454926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527828224:0@lo:400: 00000100:00100000:0.0:1789479925.956492:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479925.956515:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527828608:0@lo:13: 00000100:00100000:0.0:1789479925.956577:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479925.957215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527828736:0@lo:13: 00000100:00100000:3.0:1789479925.957248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1789479925.959956:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000100:00100000:1.0:1789479925.966227:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828608 00000100:00100000:1.0:1789479925.966240:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828608 00000100:00100000:1.0:1789479925.966288:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828736 00000100:00100000:1.0:1789479925.966291:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828736 00000100:00100000:1.0:1789479925.966308:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479925.966317:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527828608:12345-0@lo:13: 00002000:00000024:1.0:1789479925.966355:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479925.966444:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527828608:12345-0@lo:13: Request processed in 127us (9866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.966450:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479925.966467:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789479925.966474:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527828736:12345-0@lo:13: 00002000:00000024:1.0:1789479925.966484:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479925.966508:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527828736:12345-0@lo:13: Request processed in 36us (9260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479925.966516:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789479925.966805:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4d880 x1876405527828736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.966837:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527828736:0@lo:13: 00010000:00080000:3.0:1789479925.966852:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbea00 x1876405527828608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479941 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479925.966863:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527828608:0@lo:13: 00010000:00010000:2.0:1789479926.084424:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789479926.982373:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000001:00100000:2.0:1789479926.982825:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00010000:00010000:0.0:1789479927.108464:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479927.127956:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479927.128047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479927.128079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479927.128111:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479927.128142:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479927.128172:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854720 00000100:00100000:2.0:1789479927.128180:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854720 00000100:00100000:2.0:1789479927.128252:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854848 00000100:00100000:2.0:1789479927.128256:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854848 00000100:00100000:2.0:1789479927.128279:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1789479927.128288:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507854720:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1789479927.128355:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507854720:12345-192.168.206.44@tcp:400: Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479927.128363:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1789479927.128388:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1789479927.128395:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507854848:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1789479927.128426:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507854848:12345-192.168.206.44@tcp:400: Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479927.128433:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1789479927.128451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854336 00000100:00100000:2.0:1789479927.128455:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854336 00000100:00100000:2.0:1789479927.128485:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:2.0:1789479927.128493:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507854336:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1789479927.128520:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507854336:12345-192.168.206.44@tcp:400: Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479927.128526:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:2.0:1789479927.128554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854464 00000100:00100000:2.0:1789479927.128557:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854464 00000100:00100000:2.0:1789479927.129102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854592 00000100:00100000:2.0:1789479927.129107:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854592 00000100:00100000:2.0:1789479927.129418:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1789479927.129427:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507854464:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1789479927.129463:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507854464:12345-192.168.206.44@tcp:400: Request processed in 38us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479927.129470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1789479927.129484:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:2.0:1789479927.129491:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507854592:12345-192.168.206.44@tcp:400: 00000100:00100000:2.0:1789479927.129516:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507854592:12345-192.168.206.44@tcp:400: Request processed in 26us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479927.129534:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00080000:2.0:1789479927.129562:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789479927.129566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479927.129569:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479927.129573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789479927.303051:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789479928.006588:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527828864:0@lo:13: 00000100:00100000:2.0:1789479928.009237:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479928.010653:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479928.010703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527828992:0@lo:13: 00000100:00100000:3.0:1789479928.010936:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828864 00000100:00100000:3.0:1789479928.010952:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828864 00000100:00100000:3.0:1789479928.011049:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789479928.011088:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527828864:12345-0@lo:13: 00002000:00000024:3.0:1789479928.011148:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479928.011273:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527828864:12345-0@lo:13: Request processed in 216us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479928.011292:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479928.012019:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789479928.012501:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479928.012999:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4a300 x1876405527828864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479928.013034:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527828864:0@lo:13: 00000100:00100000:3.0:1789479928.013235:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527828992 00000100:00100000:3.0:1789479928.013241:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527828992 00000100:00080000:0.0:1789479928.014101:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479928.014396:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789479928.014423:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527828992:12345-0@lo:13: 00002000:00000024:3.0:1789479928.014456:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479928.014558:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527828992:12345-0@lo:13: Request processed in 152us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479928.014588:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789479928.014989:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504380 x1876405527828992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479928.015021:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527828992:0@lo:13: 00000001:00100000:3.0:1789479928.021881:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00010000:00010000:0.0:1789479928.136183:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479928.517046:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479928.517077:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527829120:0@lo:41: 00000100:00100000:0.0:1789479928.517170:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479928.517808:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829120 00000100:00100000:2.0:1789479928.517819:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829120 00000100:00100000:2.0:1789479928.517882:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789479928.517894:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527829120:12345-0@lo:41: 00000004:00000024:2.0:1789479928.517947:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789479928.518047:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527829120:12345-0@lo:41: Request processed in 155us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479928.518055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479928.518893:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527829120:0@lo:41: 00010000:00010000:3.0:1789479929.169448:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479930.180380:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479930.566081:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527829632:0@lo:400: 00000100:00100000:1.0:1789479930.566216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.566273:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527830144:0@lo:400: 00000100:00100000:1.0:1789479930.566296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.566318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527830656:0@lo:400: 00000100:00100000:1.0:1789479930.566337:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.566364:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789479930.566371:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527829248:0@lo:400: 00000100:00100000:1.0:1789479930.566395:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.566412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527829760:0@lo:400: 00000100:00100000:0.0:1789479930.567237:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830144 00000100:00100000:0.0:1789479930.567246:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830144 00000100:00100000:0.0:1789479930.567304:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830656 00000100:00100000:0.0:1789479930.567307:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830656 00000100:00100000:0.0:1789479930.567326:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479930.567335:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527830144:12345-0@lo:400: 00000100:00100000:0.0:1789479930.567389:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527830144:12345-0@lo:400: Request processed in 57us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.567396:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789479930.567409:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789479930.567414:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527830656:12345-0@lo:400: 00000100:00100000:3.0:1789479930.567658:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527829504:0@lo:400: 00000100:00100000:3.0:1789479930.567689:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479930.567713:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527830016:0@lo:400: 00000100:00100000:0.0:1789479930.568885:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527830656:12345-0@lo:400: Request processed in 1466us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.568895:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789479930.568930:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829632 00000100:00080000:2.0:1789479930.569272:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479930.569278:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479930.569324:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829504 00000100:00100000:2.0:1789479930.569330:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829504 00000100:00100000:2.0:1789479930.569366:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789479930.569374:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527829504:12345-0@lo:400: 00000100:00100000:2.0:1789479930.569840:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527829504:12345-0@lo:400: Request processed in 53us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.569848:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789479930.569871:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829248 00000100:00100000:2.0:1789479930.569875:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829248 00000100:00100000:2.0:1789479930.569898:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789479930.569904:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527829248:12345-0@lo:400: 00000100:00100000:0.0:1789479930.570215:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829632 00000100:00100000:0.0:1789479930.570252:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479930.570259:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527829632:12345-0@lo:400: 00000100:00100000:0.0:1789479930.571242:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527829632:12345-0@lo:400: Request processed in 981us (5024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.571250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479930.571283:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527829376:0@lo:400: 00000100:00100000:0.0:1789479930.571325:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.571355:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527829888:0@lo:400: 00000100:00100000:0.0:1789479930.571375:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.571393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527830400:0@lo:400: 00000100:00100000:0.0:1789479930.571411:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.571498:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527830912:0@lo:41: 00000100:00100000:0.0:1789479930.571525:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.571569:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829376 00000100:00100000:0.0:1789479930.571574:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829376 00000100:00100000:0.0:1789479930.571608:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829888 00000100:00100000:0.0:1789479930.571611:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829888 00000100:00100000:0.0:1789479930.571630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830400 00000100:00100000:0.0:1789479930.571632:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830400 00000100:00100000:0.0:1789479930.571643:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789479930.571648:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527829376:12345-0@lo:400: 00000100:00100000:0.0:1789479930.571684:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527829376:12345-0@lo:400: Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.571690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789479930.571701:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479930.571707:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527829888:12345-0@lo:400: 00000100:00100000:3.0:1789479930.571836:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479930.571906:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527830528:0@lo:400: 00000100:00100000:3.0:1789479930.571927:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479930.572008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527829504:0@lo:400: 00000100:00100000:3.0:1789479930.572321:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830912 00000100:00100000:3.0:1789479930.572326:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830912 00000100:00100000:3.0:1789479930.572353:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789479930.572359:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527830912:12345-0@lo:41: 00000004:00000024:3.0:1789479930.572393:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789479930.572864:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527829888:12345-0@lo:400: Request processed in 1156us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.572872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479930.572893:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830016 00000100:00100000:0.0:1789479930.572897:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830016 00000100:00100000:0.0:1789479930.572921:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830528 00000100:00100000:0.0:1789479930.572924:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830528 00000100:00100000:0.0:1789479930.572966:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789479930.572975:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527830400:12345-0@lo:400: 00000100:00100000:0.0:1789479930.573010:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527830400:12345-0@lo:400: Request processed in 37us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.573016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789479930.573028:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789479930.573033:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527830016:12345-0@lo:400: 00000100:00100000:0.0:1789479930.573068:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527830016:12345-0@lo:400: Request processed in 36us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.573074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789479930.573089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789479930.573094:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527830528:12345-0@lo:400: 00000100:00100000:0.0:1789479930.573120:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527830528:12345-0@lo:400: Request processed in 27us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.573125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789479930.573164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479930.573168:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479930.573220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527829376:0@lo:400: 00000100:00100000:1.0:1789479930.573233:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479930.573235:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527829888:0@lo:400: 00000100:00100000:0.0:1789479930.573247:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527830400:0@lo:400: 00000100:00100000:0.0:1789479930.573269:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527829760 00000100:00100000:0.0:1789479930.573273:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527829760 00000100:00100000:0.0:1789479930.573288:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789479930.573294:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527829760:12345-0@lo:400: 00000100:00100000:1.0:1789479930.573326:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527830272:0@lo:400: 00000100:00100000:0.0:1789479930.573329:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527829760:12345-0@lo:400: Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479930.573347:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789479930.573400:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.573428:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527830784:0@lo:400: 00000100:00100000:1.0:1789479930.573450:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479930.573469:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527829632:0@lo:400: 00010000:00080000:1.0:1789479930.573478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd180 x1876405527830144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479930.573485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527830144:0@lo:400: 00010000:00080000:1.0:1789479930.573493:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0a80 x1876405527830656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479930.573499:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527830656:0@lo:400: 00000100:00100000:1.0:1789479930.573522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527829248:0@lo:400: 00000100:00100000:1.0:1789479930.573528:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527829760:0@lo:400: 00000100:00100000:1.0:1789479930.573543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830272 00000100:00100000:1.0:1789479930.573546:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830272 00000100:00100000:1.0:1789479930.573568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527830784 00000100:00100000:1.0:1789479930.573570:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527830784 00000100:00100000:1.0:1789479930.573580:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479930.573584:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527830272:12345-0@lo:400: 00000100:00100000:1.0:1789479930.573607:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527830272:12345-0@lo:400: Request processed in 23us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479930.573611:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789479930.573619:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789479930.573622:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527830784:12345-0@lo:400: 00000100:00100000:1.0:1789479930.573641:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527830784:12345-0@lo:400: Request processed in 18us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479930.573647:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789479930.573709:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527830912:12345-0@lo:41: Request processed in 1346us (2179us total) trans 0 rc 0/0 00000100:00080000:1.0:1789479930.573746:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479930.573750:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789479930.573769:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527830272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479930.573778:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527830272:0@lo:400: 00010000:00080000:1.0:1789479930.573786:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527830784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479930.573793:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527830784:0@lo:400: 00000100:00100000:3.0:1789479930.574540:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789479930.574594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527830912:0@lo:41: 00010000:00080000:3.0:1789479930.574625:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbc380 x1876405527830016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479930.574635:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527830016:0@lo:400: 00010000:00080000:3.0:1789479930.574644:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b2300 x1876405527830528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479930.574652:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527830528:0@lo:400: 00000100:00100000:2.0:1789479930.582812:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527829248:12345-0@lo:400: Request processed in 12897us (16405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479930.582827:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789479931.078347:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527831040:0@lo:13: 00000100:00100000:3.0:1789479931.078418:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479931.078500:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831040 00000100:00100000:3.0:1789479931.078508:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831040 00000100:00100000:3.0:1789479931.078562:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789479931.078573:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527831040:12345-0@lo:13: 00002000:00000024:3.0:1789479931.078609:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479931.078650:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527831040:12345-0@lo:13: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479931.078657:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789479931.078693:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d32d80 x1876405527831040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479931.078710:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527831040:0@lo:13: 00000100:00100000:3.0:1789479931.079065:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527831168:0@lo:13: 00000100:00100000:3.0:1789479931.079108:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479931.079177:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831168 00000100:00100000:1.0:1789479931.079183:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831168 00000100:00100000:1.0:1789479931.079232:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789479931.079239:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527831168:12345-0@lo:13: 00002000:00000024:1.0:1789479931.079249:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479931.079283:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527831168:12345-0@lo:13: Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479931.079288:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789479931.079592:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862fb100 x1876405527831168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479931.079607:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527831168:0@lo:13: 00010000:00010000:0.0:1789479931.207041:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789479931.807697:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4bcb1850 20000000:00000080:0.0:1789479931.807715:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6abb49b800 uarg=0000000000000000 20000000:01000000:0.0:1789479931.807751:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789479931.807753:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789479931.807756:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789479931.807761:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789479931.807859:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789479931.807918:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789479931.807920:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789479931.809159:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789479931.809528:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789479931.809563:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789479931.809578:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789479931.809591:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789479931.809594:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789479931.809989:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1789479931.810139:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1789479931.810163:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1789479931.810179:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1789479931.810221:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789479931.810223:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789479931.810641:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789479931.810796:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789479931.810817:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789479931.810830:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789479931.810838:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789479931.810840:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789479931.811339:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789479931.811521:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789479931.811540:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789479931.811562:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789479931.811570:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789479931.811572:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789479931.812245:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1789479931.812707:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1789479931.812734:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1789479931.812749:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:0.0:1789479931.812763:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789479931.812856:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812873:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812881:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d107 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812900:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d146 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812906:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d154 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812913:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d162 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812919:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d17e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812927:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812933:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812940:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812962:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812971:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.812980:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813026:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813041:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813056:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831296:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789479931.813222:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813233:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813243:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831424:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789479931.813289:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813299:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 23 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813308:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831552:0@lo:104: 00000100:00100000:0.0:1789479931.813344:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.813371:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813380:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 23 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813470:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831680:0@lo:104: 00000100:00100000:0.0:1789479931.813494:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.813524:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813533:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 23 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813542:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831808:0@lo:104: 00000100:00100000:0.0:1789479931.813560:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.813574:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813583:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 23 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813591:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831936:0@lo:104: 00000100:00100000:0.0:1789479931.813610:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.813625:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813633:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 23 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813641:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832064:0@lo:104: 00010000:00010000:0.0:1789479931.813674:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813691:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 23 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813700:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832192:0@lo:104: 00010000:00010000:0.0:1789479931.813725:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.813734:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 23 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.813741:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832320:0@lo:104: 00010000:00010000:0.0:1789479931.813761:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.813875:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789479931.813892:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.813905:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.813913:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.813920:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831552 00000100:00100000:2.0:1789479931.813926:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831552 00000100:00100000:2.0:1789479931.813968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831680 00000100:00100000:2.0:1789479931.813971:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831680 00000100:00100000:2.0:1789479931.813981:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831808 00000100:00100000:2.0:1789479931.813983:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831808 00000100:00100000:2.0:1789479931.813990:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527831936 00000100:00100000:2.0:1789479931.813992:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527831936 00000100:00100000:2.0:1789479931.813999:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832064 00000100:00100000:2.0:1789479931.814001:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832064 00000100:00100000:2.0:1789479931.814008:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832192 00000100:00100000:2.0:1789479931.814010:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832192 00000100:00100000:2.0:1789479931.814017:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832320 00000100:00100000:2.0:1789479931.814025:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832320 00000100:00100000:2.0:1789479931.814039:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789479931.814047:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+9:10335:x1876405527831552:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814059:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814109:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789479931.814115:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+9:10335:x1876405527831552:12345-0@lo:104: Request processed in 69us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814121:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789479931.814135:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789479931.814140:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+8:10335:x1876405527831680:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814147:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814176:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789479931.814181:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+8:10335:x1876405527831680:12345-0@lo:104: Request processed in 41us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814186:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789479931.814220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479931.814226:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+7:10335:x1876405527831808:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814233:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814276:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789479931.814281:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+7:10335:x1876405527831808:12345-0@lo:104: Request processed in 56us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814286:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789479931.814303:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479931.814309:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb536050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+6:10335:x1876405527831936:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814316:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814341:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789479931.814345:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb536050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+6:10335:x1876405527831936:12345-0@lo:104: Request processed in 37us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814350:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789479931.814373:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479931.814378:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:10335:x1876405527832064:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814384:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.814504:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 23 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.814514:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832448:0@lo:104: 00000100:00100000:0.0:1789479931.814539:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789479931.814568:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.814576:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 23 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.814584:0:10335:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832576:0@lo:104: 00000100:00100000:0.0:1789479931.814599:0:10335:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479931.814608:0:10335:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479931.814632:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831552:0@lo:104: 00000100:00100000:0.0:1789479931.814639:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831680:0@lo:104: 00000100:00100000:0.0:1789479931.814645:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831808:0@lo:104: 00000100:00100000:0.0:1789479931.814652:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831936:0@lo:104: 00010000:00010000:2.0:1789479931.814680:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789479931.814685:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:10335:x1876405527832064:12345-0@lo:104: Request processed in 307us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814690:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479931.814701:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832448 00000100:00100000:2.0:1789479931.814704:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832448 00000100:00100000:2.0:1789479931.814716:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832576 00000100:00100000:2.0:1789479931.814718:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832576 00000100:00100000:2.0:1789479931.814727:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789479931.814732:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+6:10335:x1876405527832192:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814738:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814762:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789479931.814905:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+6:10335:x1876405527832192:12345-0@lo:104: Request processed in 173us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814911:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789479931.814923:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789479931.814928:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:10335:x1876405527832320:12345-0@lo:104: 00010000:00010000:2.0:1789479931.814935:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.814975:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789479931.814981:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+5:10335:x1876405527832320:12345-0@lo:104: Request processed in 53us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.814986:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789479931.814996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789479931.815001:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:10335:x1876405527832448:12345-0@lo:104: 00010000:00010000:2.0:1789479931.815008:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815028:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1789479931.815033:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+4:10335:x1876405527832448:12345-0@lo:104: Request processed in 32us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.815038:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789479931.815046:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479931.815051:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:10335:x1876405527832576:12345-0@lo:104: 00010000:00010000:2.0:1789479931.815058:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815081:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1789479931.815090:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:10335:x1876405527832576:12345-0@lo:104: Request processed in 39us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.815096:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1789479931.815112:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1789479931.815117:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815125:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0e00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.815129:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815137:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.815143:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.815149:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.815183:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815219:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.815236:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815243:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0e00/0xdaa289fda243d1ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1f5 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815255:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789479931.815259:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815274:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.815277:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815283:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.815289:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.815293:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.815306:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815311:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.815323:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815329:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1000/0xdaa289fda243d1c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1cb expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815338:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789479931.815341:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815346:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.815349:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815365:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.815371:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.815375:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.815388:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.815393:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.815398:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.815498:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832064:0@lo:104: 00000100:00100000:0.0:1789479931.815507:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832192:0@lo:104: 00000100:00100000:0.0:1789479931.815513:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832320:0@lo:104: 00000100:00100000:0.0:1789479931.815520:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832448:0@lo:104: 00000100:00100000:0.0:1789479931.815526:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527832576:0@lo:104: 00010000:00010000:2.0:1789479931.816667:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b200/0xdaa289fda243d1a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d1af expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816682:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789479931.816686:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816691:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.816695:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816702:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.816708:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.816724:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.816747:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816753:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.816761:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816910:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1a00/0xdaa289fda243d17e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d185 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816919:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789479931.816922:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816927:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.816929:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816935:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.816940:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.816944:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.816980:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.816986:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.816997:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817002:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d169 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817010:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789479931.817013:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817018:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.817020:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817025:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.817030:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.817035:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.817046:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817050:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.817054:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817059:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b400/0xdaa289fda243d154 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d15b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817065:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789479931.817073:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817078:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.817081:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817088:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.817092:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.817097:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.817108:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817113:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.817116:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817121:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243d146 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d14d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817128:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789479931.817131:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817136:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.817138:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817152:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.817159:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.817164:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.817179:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817184:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.817207:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817215:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0200/0xdaa289fda243d107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d10e expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817224:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789479931.817227:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817232:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479931.817234:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817240:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789479931.817246:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479931.817608:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789479931.817625:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817630:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479931.817635:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817641:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243d0dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d0e4 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.817655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479931.817657:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479931.817659:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479931.817668:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479931.817683:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527832704:0@lo:103: 00000100:00100000:2.0:1789479931.817741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.817961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833216:0@lo:103: 00000100:00100000:2.0:1789479931.817986:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.818013:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833728:0@lo:103: 00000100:00100000:2.0:1789479931.818030:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.818051:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789479931.818056:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833088:0@lo:103: 00000100:00100000:2.0:1789479931.818076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.818092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833600:0@lo:103: 00000100:00100000:2.0:1789479931.818109:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.818141:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832704 00000100:00100000:2.0:1789479931.818148:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832704 00010000:00010000:2.0:1789479931.818175:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 24 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.818213:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833216 00000100:00100000:2.0:1789479931.818217:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833216 00010000:00010000:2.0:1789479931.818229:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 25 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.818239:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833728 00000100:00100000:2.0:1789479931.818241:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833728 00010000:00010000:2.0:1789479931.818260:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 26 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.818271:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833088 00000100:00100000:2.0:1789479931.818273:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833088 00000100:00100000:0.0:1789479931.818440:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833600 00000100:00100000:0.0:1789479931.818445:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833600 00010000:00010000:0.0:1789479931.818462:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 28 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.818476:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789479931.818483:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa24b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+28:3648:x1876405527832704:12345-0@lo:103: 00010000:00010000:0.0:1789479931.818493:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.818498:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 28 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818506:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 28 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818518:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d1f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d1ee expref: 28 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818532:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.818585:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa24b3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+27:3648:x1876405527832704:12345-0@lo:103: Request processed in 102us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.818593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789479931.818642:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789479931.818649:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+26:3648:x1876405527833216:12345-0@lo:103: 00010000:00010000:0.0:1789479931.818658:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.818662:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 26 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818670:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 26 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818678:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d169 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d162 expref: 26 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818687:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.818707:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+25:3648:x1876405527833216:12345-0@lo:103: Request processed in 60us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.818712:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789479931.818726:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789479931.818731:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527833728:12345-0@lo:103: 00010000:00010000:0.0:1789479931.818737:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.818741:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 24 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818748:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 24 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818756:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d0e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d0dd expref: 24 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818784:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.818807:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3648:x1876405527833728:12345-0@lo:103: Request processed in 76us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.818813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789479931.818826:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789479931.818832:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+22:3648:x1876405527833600:12345-0@lo:103: 00010000:00010000:0.0:1789479931.818839:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.818843:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 22 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818851:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 22 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818861:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d10e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d107 expref: 22 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.818869:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.818888:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+21:3648:x1876405527833600:12345-0@lo:103: Request processed in 57us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.818894:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789479931.819599:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833600:0@lo:103: 00000100:00100000:1.0:1789479931.819610:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527832704:0@lo:103: 00000100:00100000:1.0:1789479931.819617:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833216:0@lo:103: 00000100:00100000:1.0:1789479931.819624:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833728:0@lo:103: 00010000:00010000:2.0:1789479931.819746:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 27 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.820070:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479931.820081:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+20:3648:x1876405527833088:12345-0@lo:103: 00010000:00010000:2.0:1789479931.820092:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.820099:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 20 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.820108:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 20 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.820122:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243d185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d17e expref: 20 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.820147:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479931.820222:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+19:3648:x1876405527833088:12345-0@lo:103: Request processed in 145us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.820229:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789479931.820302:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527832832:0@lo:103: 00000100:00100000:2.0:1789479931.820332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.820362:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527833344:0@lo:103: 00000100:00100000:2.0:1789479931.820379:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.820395:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479931.820630:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527833088:0@lo:103: 00000100:00100000:2.0:1789479931.820672:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527832960:0@lo:103: 00000100:00100000:2.0:1789479931.820696:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479931.820706:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527833472:0@lo:103: 00000100:00100000:2.0:1789479931.820723:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789479931.820744:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479931.820752:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832832 00000100:00100000:2.0:1789479931.820758:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832832 00010000:00010000:2.0:1789479931.821062:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 19 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.821080:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833344 00000100:00100000:2.0:1789479931.821083:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833344 00000100:00100000:0.0:1789479931.821296:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527832960 00000100:00100000:0.0:1789479931.821301:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527832960 00010000:00010000:0.0:1789479931.821318:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 21 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.821331:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833472 00000100:00100000:0.0:1789479931.821333:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833472 00010000:00010000:0.0:1789479931.821343:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 22 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479931.821368:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789479931.821374:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+22:3645:x1876405527832832:12345-0@lo:103: 00010000:00010000:0.0:1789479931.821384:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.821388:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 22 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821396:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 22 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821422:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1200/0xdaa289fda243d1cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d1c4 expref: 22 pid: 6515 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821432:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.821475:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+21:3645:x1876405527832832:12345-0@lo:103: Request processed in 101us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.821482:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789479931.821495:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789479931.821500:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa24b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+20:3645:x1876405527832960:12345-0@lo:103: 00010000:00010000:0.0:1789479931.821507:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.821511:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 20 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821519:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 20 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821528:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243d1af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d1a8 expref: 20 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821547:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.821568:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa24b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+19:3645:x1876405527832960:12345-0@lo:103: Request processed in 68us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.821575:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789479931.821588:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479931.821594:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+18:3645:x1876405527833472:12345-0@lo:103: 00010000:00010000:0.0:1789479931.821613:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479931.821618:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821625:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821635:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d14d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d146 expref: 18 pid: 6512 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479931.821643:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479931.821666:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+17:3645:x1876405527833472:12345-0@lo:103: Request processed in 72us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479931.821673:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789479931.821928:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527832960:0@lo:103: 00000100:00100000:1.0:1789479931.821936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527833472:0@lo:103: 00000100:00100000:1.0:1789479931.821943:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527832832:0@lo:103: 00010000:00010000:2.0:1789479931.822232:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 16 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.822256:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479931.822263:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+16:3645:x1876405527833344:12345-0@lo:103: 00010000:00010000:2.0:1789479931.822271:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.822522:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 16 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.822535:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 16 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.822548:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d15b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d154 expref: 16 pid: 6514 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.822558:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479931.822601:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+15:3645:x1876405527833344:12345-0@lo:103: Request processed in 339us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.822608:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789479931.822682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527833344:0@lo:103: 00000100:00100000:2.0:1789479931.828419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479931.828579:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831296:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789479931.828591:0:10335:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876405527831424:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789479931.828635:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479931.828884:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507854976 00000100:00100000:3.0:1789479931.828892:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507854976 00010000:00010000:3.0:1789479931.828926:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 10 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479931.828971:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1789479931.828981:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2402:x1876405507854976:12345-192.168.206.44@tcp:103: 00010000:00010000:3.0:1789479931.828996:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479931.829002:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 10 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479931.829013:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 10 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479931.829041:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d20a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2965 expref: 10 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479931.829056:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479931.829113:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:2402:x1876405507854976:12345-192.168.206.44@tcp:103: Request processed in 132us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479931.829121:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1789479931.832231:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479931.832494:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855104 00000100:00100000:2.0:1789479931.832503:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855104 00010000:00010000:2.0:1789479931.832535:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479931.832564:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:2.0:1789479931.832572:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:2402:x1876405507855104:12345-192.168.206.44@tcp:103: 00010000:00010000:2.0:1789479931.832585:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789479931.832591:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832606:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832624:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7c00/0xdaa289fda243d203 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d295e expref: 9 pid: 6515 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832657:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832665:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832683:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832689:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832696:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832704:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832721:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81487800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789479931.832727:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832736:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832754:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479931.832772:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789479931.832829:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:2402:x1876405507855104:12345-192.168.206.44@tcp:103: Request processed in 256us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479931.832842:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00010000:00010000:1.0:1789479931.832978:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.832988:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479931.833004:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d249 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479932.229108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479932.246428:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479932.246486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479932.246526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479932.246553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479932.246579:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479932.246977:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855232 00000100:00100000:3.0:1789479932.246990:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855232 00000100:00100000:3.0:1789479932.247079:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:3.0:1789479932.247091:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:2400:x1876405507855232:12345-192.168.206.44@tcp:400: 00000100:00100000:3.0:1789479932.247177:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:2400:x1876405507855232:12345-192.168.206.44@tcp:400: Request processed in 88us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479932.247185:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:0.0:1789479932.247738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855360 00000100:00100000:0.0:1789479932.247753:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855360 00000100:00100000:0.0:1789479932.247834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855488 00000100:00100000:0.0:1789479932.247838:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855488 00000100:00100000:0.0:1789479932.247865:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1789479932.247876:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507855360:12345-192.168.206.44@tcp:400: 00000100:00100000:0.0:1789479932.247962:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507855360:12345-192.168.206.44@tcp:400: Request processed in 76us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479932.247981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:0.0:1789479932.248000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:0.0:1789479932.248006:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507855488:12345-192.168.206.44@tcp:400: 00000100:00100000:0.0:1789479932.248038:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507855488:12345-192.168.206.44@tcp:400: Request processed in 32us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479932.248043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789479932.248434:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855616 00000100:00100000:1.0:1789479932.248439:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855616 00000100:00100000:1.0:1789479932.248476:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855744 00000100:00100000:1.0:1789479932.248480:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855744 00000100:00100000:1.0:1789479932.248504:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789479932.248511:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507855616:12345-192.168.206.44@tcp:400: 00000100:00100000:1.0:1789479932.248546:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507855616:12345-192.168.206.44@tcp:400: Request processed in 36us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479932.248552:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789479932.248565:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1789479932.248571:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507855744:12345-192.168.206.44@tcp:400: 00000100:00100000:1.0:1789479932.248593:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507855744:12345-192.168.206.44@tcp:400: Request processed in 23us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479932.248598:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00080000:3.0:1789479932.249631:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479932.249891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479932.249897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479932.249900:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479933.124807:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527833856:0@lo:13: 00000100:00100000:3.0:1789479933.124881:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.124989:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833856 00000100:00100000:0.0:1789479933.124997:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833856 00000100:00080000:3.0:1789479933.125042:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479933.125059:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789479933.125070:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527833856:12345-0@lo:13: 00002000:00000024:0.0:1789479933.125099:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479933.125152:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527833856:12345-0@lo:13: Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.125159:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789479933.125219:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1c700 x1876405527833856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479933.125236:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527833856:0@lo:13: 00000100:00100000:3.0:1789479933.125619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527833984:0@lo:13: 00000100:00100000:3.0:1789479933.125649:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.125863:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527833984 00000100:00100000:0.0:1789479933.125868:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527833984 00000100:00100000:0.0:1789479933.125919:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789479933.125927:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527833984:12345-0@lo:13: 00002000:00000024:0.0:1789479933.125940:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479933.125999:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527833984:12345-0@lo:13: Request processed in 73us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.126005:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789479933.126049:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f9500 x1876405527833984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479933.126068:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527833984:0@lo:13: 00000100:00080000:3.0:1789479933.126114:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789479933.252649:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789479933.252660:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6abb3b8800 from 48 10000000:01000000:1.0:1789479933.252668:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789479933.252682:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479933.252733:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.252751:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.252762:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.252812:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834112:0@lo:101: 00000100:00100000:1.0:1789479933.252900:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.252982:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.253292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834112 00000100:00100000:2.0:1789479933.253300:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834112 00000100:00100000:2.0:1789479933.253365:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789479933.253374:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+15:6517:x1876405527834112:12345-0@lo:101: 00010000:00010000:2.0:1789479933.253387:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479933.253400:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047b200/0xdaa289fda243d257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d250 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.253423:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047b200/0xdaa289fda243d257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d250 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.253435:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047b200/0xdaa289fda243d257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d250 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.253444:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b200, rc 0) 00000100:00100000:2.0:1789479933.253492:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834112:12345-0@lo:101: Request processed in 119us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.253505:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789479933.253731:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834112:0@lo:101: 00010000:00010000:1.0:1789479933.253746:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.253755:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.253812:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834240:0@lo:501: 00000100:00100000:1.0:1789479933.253836:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.253863:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.253969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834240 00000100:00100000:2.0:1789479933.253974:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834240 00000100:00100000:2.0:1789479933.254009:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789479933.254016:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834240:12345-0@lo:501: 00000100:00100000:2.0:1789479933.254126:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834240:12345-0@lo:501: Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.254133:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789479933.254396:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834240:0@lo:501: 00000100:00100000:1.0:1789479933.254422:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834368:0@lo:503: 00000100:00100000:1.0:1789479933.254458:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.254485:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.254535:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834368 00000100:00100000:3.0:1789479933.254539:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834368 00000100:00100000:3.0:1789479933.254579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789479933.254586:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834368:12345-0@lo:503: 00000100:00100000:3.0:1789479933.254667:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834368:12345-0@lo:503: Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.254674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789479933.254853:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834368:0@lo:503: 00000100:00100000:1.0:1789479933.255251:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10352:1876405527834496:0@lo:502: 00000100:00100000:1.0:1789479933.255284:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.255318:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.257003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834496 00000100:00100000:3.0:1789479933.257014:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834496 00000100:00100000:3.0:1789479933.257086:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789479933.257095:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:10352:x1876405527834496:12345-0@lo:502: 00000100:00100000:3.0:1789479933.257279:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+16:10352:x1876405527834496:12345-0@lo:502: Request processed in 185us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.257287:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789479933.257546:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10352:1876405527834496:0@lo:502: 00000100:00100000:1.0:1789479933.257899:0:10352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10352:1876405527834624:0@lo:502: 00000100:00100000:1.0:1789479933.258810:0:10352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.258987:0:10352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.264695:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834624 00000100:00100000:2.0:1789479933.264719:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834624 00000100:00100000:2.0:1789479933.264786:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789479933.264796:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:10352:x1876405527834624:12345-0@lo:502: 00000100:00100000:2.0:1789479933.264973:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+16:10352:x1876405527834624:12345-0@lo:502: Request processed in 178us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.264981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789479933.265167:0:10352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10352:1876405527834624:0@lo:502: 00000040:00080000:1.0:1789479933.265232:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789479933.265336:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789479933.265372:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789479933.265382:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.265406:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479933.265422:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789479933.265424:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789479933.265427:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789479933.265455:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.265464:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.265472:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479933.265501:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834752:0@lo:101: 00000100:00100000:0.0:1789479933.265535:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.265579:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617600 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.265788:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834752 00000100:00100000:3.0:1789479933.265794:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834752 00000100:00100000:3.0:1789479933.265835:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789479933.265843:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+16:6517:x1876405527834752:12345-0@lo:101: 00010000:00010000:3.0:1789479933.265853:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479933.265866:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d25e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.265886:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d25e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.265907:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d25e expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.265915:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7800, rc 0) 00000100:00100000:3.0:1789479933.265966:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527834752:12345-0@lo:101: Request processed in 123us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.265972:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789479933.266154:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834752:0@lo:101: 00010000:00010000:1.0:1789479933.266167:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.266177:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.268327:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834880:0@lo:501: 00000100:00100000:1.0:1789479933.268386:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.268426:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.268766:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527834880 00000100:00100000:0.0:1789479933.268773:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527834880 00000100:00100000:0.0:1789479933.268818:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789479933.268827:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527834880:12345-0@lo:501: 00000100:00100000:0.0:1789479933.268963:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527834880:12345-0@lo:501: Request processed in 137us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.268971:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789479933.269257:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527834880:0@lo:501: 00000100:00100000:1.0:1789479933.269291:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835008:0@lo:503: 00000100:00100000:1.0:1789479933.269347:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.269365:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.269535:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835008 00000100:00100000:2.0:1789479933.269540:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835008 00000100:00100000:2.0:1789479933.269578:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789479933.269584:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527835008:12345-0@lo:503: 00000100:00100000:2.0:1789479933.269664:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527835008:12345-0@lo:503: Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.269670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789479933.269954:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835008:0@lo:503: 00000100:00100000:2.0:1789479933.271180:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10353:1876405527835136:0@lo:502: 00000100:00100000:2.0:1789479933.271462:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.271499:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb6f3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.271540:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835136 00000100:00100000:1.0:1789479933.271546:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835136 00000100:00100000:1.0:1789479933.271586:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789479933.271595:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:10353:x1876405527835136:12345-0@lo:502: 00000100:00100000:1.0:1789479933.271709:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+17:10353:x1876405527835136:12345-0@lo:502: Request processed in 115us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.271726:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789479933.271854:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10353:1876405527835136:0@lo:502: 00000020:01000000:3.0:1789479933.271879:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479933.271888:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.271890:0:10353:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789479933.271895:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789479933.271925:0:10353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10353:1876405527835264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.271968:0:10353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.271995:0:10353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.272553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835264 00000100:00100000:2.0:1789479933.272578:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835264 00000100:00100000:2.0:1789479933.272612:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789479933.272620:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:10353:x1876405527835264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.272720:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+17:10353:x1876405527835264:12345-0@lo:502:llog_process_th.0 Request processed in 101us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.272727:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789479933.272906:0:10353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10353:1876405527835264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.272928:0:10353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479933.272933:0:10353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.272935:0:10353:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789479933.272938:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789479933.273097:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789479933.273118:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789479933.273128:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.273139:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479933.273149:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789479933.273151:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6abb3b8000 from 48 10000000:01000000:1.0:1789479933.273154:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789479933.273179:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.273224:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.273234:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.273249:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.273279:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.273303:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.274492:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835392 00000100:00100000:2.0:1789479933.274501:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835392 00000100:00100000:2.0:1789479933.274544:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789479933.274552:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+17:6517:x1876405527835392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479933.274563:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479933.274585:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243d273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d26c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.274607:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243d273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d26c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.274617:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243d273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d26c expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.274625:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b600, rc 0) 00000100:00100000:2.0:1789479933.274668:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527835392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.274673:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789479933.275010:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.275024:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.275033:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.275098:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.275122:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.275149:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.275210:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835520 00000100:00100000:2.0:1789479933.275216:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835520 00000100:00100000:2.0:1789479933.275246:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789479933.275252:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527835520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.275592:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527835520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.275599:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789479933.275649:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.275672:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.275713:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.275732:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.275807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835648 00000100:00100000:3.0:1789479933.275812:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835648 00000100:00100000:3.0:1789479933.275840:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789479933.275847:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527835648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.275927:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527835648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.275933:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789479933.276007:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527835648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.276531:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10354:1876405527835776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.276583:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.276621:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.276722:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835776 00000100:00100000:3.0:1789479933.276727:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835776 00000100:00100000:3.0:1789479933.276760:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789479933.276768:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:10354:x1876405527835776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.276852:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:10354:x1876405527835776:12345-0@lo:502:llog_process_th.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.276858:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789479933.277030:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10354:1876405527835776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.277068:0:10354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10354:1876405527835904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.277099:0:10354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.277122:0:10354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.277170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527835904 00000100:00100000:2.0:1789479933.277175:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527835904 00000100:00100000:2.0:1789479933.277230:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789479933.277237:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:10354:x1876405527835904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.277317:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+18:10354:x1876405527835904:12345-0@lo:502:llog_process_th.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.277323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789479933.277542:0:10354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10354:1876405527835904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789479933.277561:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789479933.277814:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789479933.277833:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789479933.277841:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.277853:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789479933.277862:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789479933.277864:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789479933.277867:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789479933.277899:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.277907:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.277917:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.277936:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.277979:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.278008:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.278100:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836032 00000100:00100000:3.0:1789479933.278105:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836032 00000100:00100000:3.0:1789479933.278144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789479933.278151:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+18:6517:x1876405527836032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.278159:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479933.278171:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6200/0xdaa289fda243d281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d27a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.278210:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6200/0xdaa289fda243d281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d27a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.278220:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6200/0xdaa289fda243d281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d27a expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.278229:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6200, rc 0) 00000100:00100000:3.0:1789479933.278261:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.278267:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789479933.279010:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.279024:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.279034:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479933.279091:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.279120:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.279149:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.279214:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836160 00000100:00100000:3.0:1789479933.279220:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836160 00000100:00100000:3.0:1789479933.279253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789479933.279260:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.279522:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.279529:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789479933.279710:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.279736:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.279769:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.279784:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.279869:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836288 00000100:00100000:2.0:1789479933.279873:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836288 00000100:00100000:2.0:1789479933.279903:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789479933.279910:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.280004:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.280010:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789479933.280103:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.280680:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10355:1876405527836416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.280787:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.280815:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.280864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836416 00000100:00100000:2.0:1789479933.280869:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836416 00000100:00100000:2.0:1789479933.280904:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789479933.280913:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+19:10355:x1876405527836416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.281014:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+19:10355:x1876405527836416:12345-0@lo:502:llog_process_th.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.281021:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789479933.281127:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10355:1876405527836416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479933.281148:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479933.281161:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479933.281163:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789479933.281168:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789479933.281509:0:10355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10355:1876405527836544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.281545:0:10355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479933.281879:0:10355:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789479933.281924:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836544 00000100:00100000:3.0:1789479933.281930:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836544 00000100:00100000:3.0:1789479933.281973:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789479933.281981:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:10355:x1876405527836544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.282074:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+19:10355:x1876405527836544:12345-0@lo:502:llog_process_th.0 Request processed in 95us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479933.282086:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789479933.282156:0:10355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10355:1876405527836544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479933.282178:0:10355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479933.282183:0:10355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479933.282185:0:10355:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789479933.282217:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789479933.282398:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789479933.282417:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789479933.282426:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.282437:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479933.282457:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789479933.282461:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a866ce000 from 48 10000000:01000000:3.0:1789479933.282463:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789479933.282487:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.282495:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.282503:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.282520:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.282547:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.282585:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.282719:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836672 00000100:00100000:1.0:1789479933.282724:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836672 00000100:00100000:1.0:1789479933.282757:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789479933.282764:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+19:6517:x1876405527836672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.282774:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.282785:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243d28f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d288 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.282804:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243d28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d288 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.282814:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243d28f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d288 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.282821:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bdc00, rc 0) 00000100:00100000:1.0:1789479933.282849:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527836672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.282855:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789479933.283288:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.283301:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.283321:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.283380:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.283404:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.283419:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.283600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836800 00000100:00100000:1.0:1789479933.283605:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836800 00000100:00100000:1.0:1789479933.283633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789479933.283639:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527836800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.283735:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527836800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.283741:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789479933.283881:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.283908:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.283951:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.283976:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.284014:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527836928 00000100:00100000:1.0:1789479933.284018:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527836928 00000100:00100000:1.0:1789479933.284046:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789479933.284053:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527836928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.284118:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527836928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.284124:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789479933.284212:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527836928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.284877:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10356:1876405527837056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.284917:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.284958:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.285007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837056 00000100:00100000:1.0:1789479933.285012:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837056 00000100:00100000:1.0:1789479933.285042:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789479933.285049:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:10356:x1876405527837056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.285133:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:10356:x1876405527837056:12345-0@lo:502:llog_process_th.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.285140:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789479933.285223:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10356:1876405527837056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.285263:0:10356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10356:1876405527837184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479933.285293:0:10356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.285327:0:10356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.285580:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837184 00000100:00100000:0.0:1789479933.285585:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837184 00000100:00100000:0.0:1789479933.285615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789479933.285623:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:10356:x1876405527837184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.285690:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:10356:x1876405527837184:12345-0@lo:502:llog_process_th.0 Request processed in 69us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.285697:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789479933.285971:0:10356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10356:1876405527837184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789479933.285992:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789479933.286121:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789479933.286141:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789479933.286150:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.286160:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479933.286169:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789479933.286171:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1789479933.286174:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789479933.286230:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.286238:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.286255:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.286270:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.286299:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.286532:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.286690:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837312 00000100:00100000:0.0:1789479933.286695:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837312 00000100:00100000:0.0:1789479933.286836:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789479933.286844:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527837312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479933.286852:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479933.286864:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81486400/0xdaa289fda243d29d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d296 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.286884:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81486400/0xdaa289fda243d29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d296 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.286892:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81486400/0xdaa289fda243d29d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d296 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.286911:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81486400, rc 0) 00000100:00100000:0.0:1789479933.286963:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.286969:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789479933.287021:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.287033:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.287040:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.287088:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.287111:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.292855:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.296544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837440 00000100:00100000:1.0:1789479933.296559:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837440 00000100:00100000:1.0:1789479933.296633:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789479933.296642:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.296934:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (9820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.296966:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789479933.297066:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.297116:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.297161:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.297254:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.297688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837568 00000100:00100000:1.0:1789479933.297694:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837568 00000100:00100000:1.0:1789479933.297864:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789479933.297871:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.298008:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.298015:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789479933.306138:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.306918:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10357:1876405527837696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.306998:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.307027:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617000 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.307132:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837696 00000100:00100000:1.0:1789479933.307138:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837696 00000100:00100000:1.0:1789479933.307182:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789479933.307217:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:10357:x1876405527837696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.307347:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:10357:x1876405527837696:12345-0@lo:502:llog_process_th.0 Request processed in 157us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.307355:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789479933.307548:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10357:1876405527837696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.307589:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479933.307601:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.307604:0:10357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789479933.307609:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789479933.307630:0:10357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10357:1876405527837824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.307667:0:10357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.307705:0:10357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.307786:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837824 00000100:00100000:0.0:1789479933.307790:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837824 00000100:00100000:0.0:1789479933.307822:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789479933.307829:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:10357:x1876405527837824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.307907:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:10357:x1876405527837824:12345-0@lo:502:llog_process_th.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.307913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789479933.308074:0:10357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10357:1876405527837824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.308092:0:10357:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479933.308097:0:10357:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.308098:0:10357:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789479933.308102:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1789479933.308335:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1789479933.308358:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789479933.308368:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.308380:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479933.308390:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789479933.308393:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6a83cfb000 from 48 10000000:01000000:0.0:1789479933.308395:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789479933.308420:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.308434:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.308444:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479933.308457:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.308484:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.308514:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a6170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.308553:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527837952 00000100:00100000:1.0:1789479933.308557:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527837952 00000100:00100000:1.0:1789479933.308598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789479933.308606:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527837952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479933.308615:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479933.308627:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bca00/0xdaa289fda243d2ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d2a4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.308648:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bca00/0xdaa289fda243d2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d2a4 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.308658:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bca00/0xdaa289fda243d2ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2a4 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479933.308673:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bca00, rc 0) 00000100:00100000:1.0:1789479933.308720:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527837952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.308726:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789479933.308985:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527837952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.308998:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.309007:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.309060:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.309085:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.309110:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.309150:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838080 00000100:00100000:1.0:1789479933.309155:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838080 00000100:00100000:1.0:1789479933.309186:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789479933.309232:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527838080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479933.309477:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527838080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.309485:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789479933.309543:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.309584:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.309620:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.309649:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.309793:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838208 00000100:00100000:0.0:1789479933.309798:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838208 00000100:00100000:0.0:1789479933.309829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789479933.309836:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527838208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.309917:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527838208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.309923:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789479933.310028:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.310362:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10358:1876405527838336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.310393:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.310408:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617480 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.310513:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838336 00000100:00100000:1.0:1789479933.310518:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838336 00000100:00100000:1.0:1789479933.310548:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789479933.310555:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:10358:x1876405527838336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.310656:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:10358:x1876405527838336:12345-0@lo:502:llog_process_th.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.310663:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789479933.310854:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10358:1876405527838336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.310893:0:10358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10358:1876405527838464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.310926:0:10358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.310966:0:10358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.312504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838464 00000100:00100000:1.0:1789479933.312515:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838464 00000100:00100000:1.0:1789479933.312612:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789479933.312622:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:10358:x1876405527838464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.312761:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:10358:x1876405527838464:12345-0@lo:502:llog_process_th.0 Request processed in 140us (1833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.312767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789479933.312843:0:10358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10358:1876405527838464:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789479933.312871:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789479933.313733:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789479933.313761:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789479933.313770:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.313782:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479933.313792:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789479933.313794:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789479933.313797:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789479933.313830:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.313839:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.313848:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.313868:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.313911:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479933.322599:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.327080:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838592 00000100:00100000:0.0:1789479933.327095:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838592 00000100:00100000:0.0:1789479933.327154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789479933.327163:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527838592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479933.327179:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479933.327222:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d2b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d2b2 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.327270:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d2b2 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.327281:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d2b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2b2 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479933.327290:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81487800, rc 0) 00000100:00100000:0.0:1789479933.327369:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527838592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (13456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.327375:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789479933.327446:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.327463:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.327472:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.327541:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.327570:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.328342:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.328427:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838720 00000100:00100000:0.0:1789479933.328433:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838720 00000100:00100000:0.0:1789479933.328460:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789479933.328467:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527838720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.328591:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527838720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.328599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789479933.328786:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.328822:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.328867:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.328893:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.328953:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838848 00000100:00100000:0.0:1789479933.328958:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838848 00000100:00100000:0.0:1789479933.328976:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1789479933.328982:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527838848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479933.329065:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527838848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.329070:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789479933.330009:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527838848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.330805:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10359:1876405527838976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.330863:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.330911:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479933.330986:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527838976 00000100:00100000:0.0:1789479933.330993:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527838976 00000100:00100000:0.0:1789479933.331045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1789479933.331053:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:10359:x1876405527838976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479933.331167:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:10359:x1876405527838976:12345-0@lo:502:llog_process_th.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.331175:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789479933.331470:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10359:1876405527838976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.331495:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789479933.331503:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.331506:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789479933.331511:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789479933.331530:0:10359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10359:1876405527839104:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479933.331636:0:10359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.331669:0:10359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891900 going to sleep for 11 seconds 00000100:00100000:1.0:1789479933.331789:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839104 00000100:00100000:1.0:1789479933.331794:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839104 00000100:00100000:1.0:1789479933.331832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789479933.331840:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:10359:x1876405527839104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479933.331934:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:10359:x1876405527839104:12345-0@lo:502:llog_process_th.0 Request processed in 94us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479933.331952:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789479933.332050:0:10359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10359:1876405527839104:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789479933.332068:0:10359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789479933.332073:0:10359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789479933.332075:0:10359:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789479933.332079:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789479933.336025:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789479933.336065:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789479933.336076:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.336090:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479933.336545:0:6517:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789479933.336549:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a6a95c999c0 from 1 10000000:01000000:3.0:1789479933.336552:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789479933.336606:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.336614:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.336626:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.336651:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527839232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.336721:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.336759:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.336925:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839232 00000100:00100000:2.0:1789479933.336931:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839232 00000100:00100000:2.0:1789479933.336986:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789479933.336994:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527839232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479933.337006:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479933.337017:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243d2c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d2c0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.337036:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243d2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d2c0 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.337046:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243d2c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2c0 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479933.337054:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b400, rc 0) 00000100:00100000:2.0:1789479933.337094:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527839232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479933.337100:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789479933.337358:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527839232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479933.337384:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.337392:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479933.337447:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527839360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479933.337471:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479933.337495:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479933.337597:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839360 00000100:00100000:2.0:1789479933.337601:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839360 00000100:00100000:2.0:1789479933.337631:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789479933.337638:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527839360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479933.337721:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527839360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (249us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789479933.337728:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789479933.337989:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527839360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789479933.338016:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789479933.338022:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479933.338031:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479933.638545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527839488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789479933.638616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479933.638761:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839488 00000100:00100000:0.0:1789479933.638769:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839488 00000100:00100000:0.0:1789479933.638818:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789479933.638827:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527839488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789479933.638857:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479933.638903:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527839488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479933.638910:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789479933.640041:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527839488:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789479934.276427:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479935.300330:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479935.317570:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479935.317830:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507855872 00000100:00100000:1.0:1789479935.317840:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507855872 00000100:00100000:1.0:1789479935.317894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:1.0:1789479935.317904:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:6182:x1876405507855872:12345-192.168.206.44@tcp:101: 00010000:00010000:1.0:1789479935.317919:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479935.317946:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bd400/0xdaa289fda243d2ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d29d5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.317971:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bd400/0xdaa289fda243d2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29d5 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.317982:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bd400/0xdaa289fda243d2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29d5 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.317991:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd400, rc 0) 00000100:00100000:1.0:1789479935.318046:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507855872:12345-192.168.206.44@tcp:101: Request processed in 144us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.318053:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:1.0:1789479935.325502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479935.325667:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856000 00000100:00100000:0.0:1789479935.325676:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856000 00000100:00100000:0.0:1789479935.325738:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:0.0:1789479935.325748:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507856000:12345-192.168.206.44@tcp:501: 00000100:00100000:0.0:1789479935.325892:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507856000:12345-192.168.206.44@tcp:501: Request processed in 146us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.325900:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:0.0:1789479935.332873:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479935.333394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856128 00000100:00100000:1.0:1789479935.333403:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856128 00000100:00100000:1.0:1789479935.333477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:1.0:1789479935.333487:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507856128:12345-192.168.206.44@tcp:503: 00000100:00100000:1.0:1789479935.333608:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507856128:12345-192.168.206.44@tcp:503: Request processed in 122us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.333615:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:3.0:1789479935.355507:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479935.355607:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856256 00000100:00100000:2.0:1789479935.355616:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856256 00000100:00100000:2.0:1789479935.355679:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 247 00000100:00100000:2.0:1789479935.355699:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6674:x1876405507856256:12345-192.168.206.44@tcp:502: 00000100:00100000:2.0:1789479935.356010:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6674:x1876405507856256:12345-192.168.206.44@tcp:502: Request processed in 321us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479935.356018:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 247 00000100:00100000:2.0:1789479935.367285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479935.369336:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856384 00000100:00100000:0.0:1789479935.369349:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856384 00000100:00100000:0.0:1789479935.369416:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 248 00000100:00100000:0.0:1789479935.369427:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6674:x1876405507856384:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789479935.369583:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6674:x1876405507856384:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 157us (2305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.369591:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 248 00000100:00100000:0.0:1789479935.384506:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479935.384818:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856512 00000100:00100000:1.0:1789479935.384827:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856512 00000100:00100000:1.0:1789479935.384885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 249 00000100:00100000:1.0:1789479935.384893:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507856512:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479935.384908:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479935.384925:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bde00/0xdaa289fda243d2d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d29dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.384963:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bde00/0xdaa289fda243d2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29dc expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.384973:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bde00/0xdaa289fda243d2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29dc expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479935.384981:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bde00, rc 0) 00000100:00100000:1.0:1789479935.385035:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507856512:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 143us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.385041:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 249 00000100:00100000:3.0:1789479935.391084:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479935.391298:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856640 00000100:00100000:2.0:1789479935.391311:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856640 00000100:00100000:2.0:1789479935.391376:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00100000:2.0:1789479935.391385:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507856640:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479935.391499:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507856640:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 114us (429us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789479935.391508:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00100000:0.0:1789479935.684870:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479935.684897:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527839616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479935.684977:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479935.685246:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839616 00000100:00100000:3.0:1789479935.685259:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839616 00000100:00100000:3.0:1789479935.685350:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789479935.685363:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527839616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479935.685408:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479935.685509:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527839616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 149us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479935.685534:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789479935.685851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527839616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479935.686505:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527839744:0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.686576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.686718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527839872:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.686755:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479935.686847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839872 00000100:00100000:0.0:1789479935.686856:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839872 00000100:00100000:0.0:1789479935.686909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789479935.686919:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527839872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.687001:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527839872:12345-0@lo:400:kworker.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.687009:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789479935.687046:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527839744 00000100:00100000:0.0:1789479935.687050:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527839744 00000100:00100000:0.0:1789479935.687079:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789479935.687086:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527839744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.687174:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527839872:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527840128:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700184:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700268:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527840640:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700320:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700341:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527841152:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700362:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700389:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789479935.700396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527840000:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700421:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527840512:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700479:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527841024:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700501:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840640 00000100:00100000:1.0:1789479935.700551:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840640 00000100:00100000:1.0:1789479935.700609:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841152 00000100:00100000:1.0:1789479935.700613:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841152 00000100:00100000:1.0:1789479935.700626:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840512 00000100:00100000:1.0:1789479935.700629:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840512 00000100:00100000:1.0:1789479935.700643:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841024 00000100:00100000:1.0:1789479935.700646:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841024 00000100:00100000:1.0:1789479935.700663:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479935.700671:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527840640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700729:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527840640:12345-0@lo:400:kworker.0 Request processed in 58us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.700736:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789479935.700772:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789479935.700779:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527841152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700807:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527841152:12345-0@lo:400:kworker.0 Request processed in 29us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.700812:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789479935.700822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789479935.700827:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527840512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700849:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527840512:12345-0@lo:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.700854:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789479935.700863:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789479935.700869:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527841024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700892:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527841024:12345-0@lo:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479935.700898:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789479935.700925:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527840384:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.700964:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.700987:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527840896:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.701014:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.701036:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789479935.701044:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527840256:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.701072:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527839744:12345-0@lo:400:kworker.0 Request processed in 13982us (14492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.701082:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789479935.701118:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840128 00000100:00100000:3.0:1789479935.701123:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840128 00000100:00100000:3.0:1789479935.701161:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840384 00000100:00100000:3.0:1789479935.701164:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840384 00000100:00100000:3.0:1789479935.701178:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840896 00000100:00100000:3.0:1789479935.701181:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840896 00000100:00100000:3.0:1789479935.701212:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789479935.701220:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527840128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.701723:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479935.701743:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527840768:0@lo:400:kworker.0 00010000:00080000:0.0:1789479935.701785:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d31f80 x1876405527840512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.701802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527840512:0@lo:400:kworker.0 00010000:00080000:0.0:1789479935.701813:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbc000 x1876405527841024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.701909:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527841024:0@lo:400:kworker.0 00010000:00080000:0.0:1789479935.701925:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d30380 x1876405527840640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.701947:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527840640:0@lo:400:kworker.0 00010000:00080000:0.0:1789479935.702211:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd180 x1876405527841152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479935.702232:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527841152:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.702289:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840256 00000100:00100000:0.0:1789479935.702295:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840256 00000100:00100000:0.0:1789479935.702328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789479935.702336:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527840384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.702389:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527840384:12345-0@lo:400:kworker.0 Request processed in 53us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.702396:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789479935.702410:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789479935.702416:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527840896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.702440:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527840896:12345-0@lo:400:kworker.0 Request processed in 25us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.702445:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789479935.702454:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789479935.702459:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527840256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.702480:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527840256:12345-0@lo:400:kworker.0 Request processed in 21us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.702495:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789479935.702537:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479935.702542:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479935.702545:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479935.702548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479935.702572:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840000 00000100:00100000:0.0:1789479935.702575:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840000 00000100:00100000:0.0:1789479935.702615:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789479935.702621:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527840000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.702656:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527840000:12345-0@lo:400:kworker.0 Request processed in 36us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.702661:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789479935.702686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527840000:0@lo:400:kworker.0 00000100:00100000:2.0:1789479935.713644:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527839744:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.714300:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789479935.714526:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d33480 x1876405527840384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479935.714561:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527840384:0@lo:400:kworker.0 00010000:00080000:1.0:1789479935.714580:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbed80 x1876405527840896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479935.714590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527840896:0@lo:400:kworker.0 00000100:00100000:1.0:1789479935.714620:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527840256:0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.715228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527840768 00000100:00100000:0.0:1789479935.715239:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527840768 00000100:00100000:0.0:1789479935.715399:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789479935.715411:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527840768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479935.715505:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527840768:12345-0@lo:400:kworker.0 Request processed in 97us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479935.715512:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789479935.715669:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479935.715703:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527840768:0@lo:400:kworker.0 00000100:00100000:3.0:1789479935.715905:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527840128:12345-0@lo:400:kworker.0 Request processed in 14684us (15720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479935.715914:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789479935.716532:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527840128:0@lo:400:kworker.0 00000100:00100000:0.0:1789479936.196783:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527841280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479936.196889:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.197164:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841280 00000100:00100000:2.0:1789479936.197175:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841280 00000100:00100000:2.0:1789479936.197279:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789479936.197291:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527841280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789479936.197340:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479936.197405:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527841280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.197413:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789479936.197660:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbea00 x1876405527841280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479936.197684:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527841280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789479936.197820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527841408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479936.197859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479936.198607:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841408 00000100:00100000:2.0:1789479936.198616:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841408 00000100:00100000:2.0:1789479936.198667:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789479936.198677:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527841408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479936.198698:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479936.198756:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527841408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479936.198838:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789479936.199012:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f8a80 x1876405527841408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479936.199029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527841408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789479936.325259:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479937.350662:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479937.371494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479937.371542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479937.371573:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479937.371593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479937.371622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479937.371658:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856768 00000100:00100000:2.0:1789479937.371671:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856768 00000100:00100000:2.0:1789479937.371742:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:2.0:1789479937.371753:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2402:x1876405507856768:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479937.371858:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2402:x1876405507856768:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 107us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479937.371866:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:2.0:1789479937.371904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857024 00000100:00100000:2.0:1789479937.371909:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857024 00000100:00100000:2.0:1789479937.371964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507856896 00000100:00100000:2.0:1789479937.371968:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507856896 00000100:00100000:2.0:1789479937.371993:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1789479937.372000:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857024:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479937.372034:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857024:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479937.372041:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1789479937.372054:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:2.0:1789479937.372060:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507856896:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479937.372083:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507856896:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479937.372089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:2.0:1789479937.372108:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857280 00000100:00100000:2.0:1789479937.372112:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857280 00000100:00100000:2.0:1789479937.372140:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857152 00000100:00100000:2.0:1789479937.372143:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857152 00000100:00100000:2.0:1789479937.372165:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1789479937.372172:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857280:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479937.372235:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857280:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479937.372248:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1789479937.372261:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:2.0:1789479937.372267:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857152:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479937.372294:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507857152:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479937.372299:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00080000:2.0:1789479937.372468:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789479937.372473:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479937.372476:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479937.372478:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1789479937.613502:0:10396:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff84f58850 20000000:00000080:3.0:1789479937.613527:0:10396:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6986b25800 uarg=0000000000000000 20000000:01000000:3.0:1789479937.613590:0:10396:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789479937.613598:0:10396:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789479937.613604:0:10396:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789479937.623574:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789479937.628415:0:10396:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789479937.640533:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789479937.642420:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789479937.642466:0:10396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789479937.642486:0:10396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789479937.642506:0:10396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642523:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642531:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642550:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642555:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642564:0:10396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642570:0:10396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642608:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.642622:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 9 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479937.642638:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841536:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789479937.644017:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.644035:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 23 pid: 6515 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479937.644050:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841664:0@lo:104: 00000100:00100000:1.0:1789479937.644106:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479937.644145:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.644164:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 23 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479937.644173:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841792:0@lo:104: 00000100:00100000:1.0:1789479937.644219:0:10396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789479937.644247:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.644255:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 23 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479937.644263:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841920:0@lo:104: 00010000:00010000:1.0:1789479937.644287:0:10396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.644293:0:10396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 23 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479937.644300:0:10396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527842048:0@lo:104: 00000100:00100000:1.0:1789479937.644315:0:10396:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb480 going to sleep for 11 seconds 00000100:00100000:3.0:1789479937.644568:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789479937.644615:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.644641:0:6503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.644653:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841664 00000100:00100000:3.0:1789479937.644800:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841664 00000100:00100000:3.0:1789479937.644847:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841792 00000100:00100000:3.0:1789479937.644852:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841792 00000100:00100000:3.0:1789479937.644874:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527841920 00000100:00100000:3.0:1789479937.644878:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527841920 00000100:00100000:3.0:1789479937.644887:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842048 00000100:00100000:3.0:1789479937.644889:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842048 00000100:00100000:3.0:1789479937.644905:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789479937.644931:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+6:10396:x1876405527841664:12345-0@lo:104: 00010000:00010000:3.0:1789479937.644948:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645040:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479937.645046:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+6:10396:x1876405527841664:12345-0@lo:104: Request processed in 132us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.645053:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789479937.645073:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789479937.645081:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb54f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+5:10396:x1876405527841792:12345-0@lo:104: 00010000:00010000:3.0:1789479937.645089:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645124:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479937.645131:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789479937.645139:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb54f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+5:10396:x1876405527841792:12345-0@lo:104: Request processed in 59us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.645145:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789479937.645147:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645160:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479937.645165:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645177:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.645183:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 10000000:00010000:2.0:1789479937.645224:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.645229:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:10396:x1876405527841920:12345-0@lo:104: 10000000:01000000:2.0:1789479937.645250:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789479937.645254:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645303:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645304:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789479937.645318:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:10396:x1876405527841920:12345-0@lo:104: Request processed in 96us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.645336:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:2.0:1789479937.645339:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789479937.645355:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479937.645365:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:10396:x1876405527842048:12345-0@lo:104: 00010000:00010000:2.0:1789479937.645375:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645376:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645403:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1600/0xdaa289fda243d0f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d100 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645423:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789479937.645427:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645435:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789479937.645435:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81474c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479937.645443:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.645449:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:10396:x1876405527842048:12345-0@lo:104: Request processed in 84us (804us total) trans 0 rc 0/0 00010000:00010000:2.0:1789479937.645460:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.645467:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 10000000:00010000:2.0:1789479937.645478:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479937.645485:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789479937.645505:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645511:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479937.645518:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645525:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81474c00/0xdaa289fda243cfd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cfda expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645527:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789479937.645535:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645549:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7000 already unused, calling callback (ffffffffc136bc20) 00010000:00010000:2.0:1789479937.645552:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1789479937.645554:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645559:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645580:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645580:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789479937.645587:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789479937.645604:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645609:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789479937.645618:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1789479937.645624:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789479937.645632:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789479937.645658:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645664:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645666:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789479937.645689:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789479937.645694:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645706:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6600/0xdaa289fda243cf71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf78 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645709:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.645723:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243cf7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243cf86 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479937.645737:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479937.645741:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789479937.645746:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479937.645747:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479937.645752:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479937.645755:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479937.645767:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479937.645770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527842176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479937.645804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527842432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789479937.645847:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.645861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527842304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479937.646324:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.646381:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842176 00000100:00100000:3.0:1789479937.646388:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842176 00010000:00010000:3.0:1789479937.646412:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 24 pid: 6515 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.646435:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842304 00000100:00100000:3.0:1789479937.646439:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842304 00010000:00010000:3.0:1789479937.646449:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 25 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.646465:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479937.646471:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+25:3647:x1876405527842176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479937.646482:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479937.646488:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 25 pid: 6515 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646506:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 25 pid: 6515 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646523:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479937.646553:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+25:3647:x1876405527842176:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.646560:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479937.646574:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479937.646580:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527842304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479937.646587:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479937.646591:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646599:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646608:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479937.646634:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527842304:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.646639:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789479937.646659:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527842560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479937.646687:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.646713:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842560 00000100:00100000:3.0:1789479937.646717:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842560 00010000:00010000:3.0:1789479937.646731:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.646840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479937.646852:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527842560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479937.646860:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479937.646864:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646873:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.646883:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479937.646911:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527842560:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.646917:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789479937.646969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527842560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479937.646993:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527842304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789479937.647019:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479937.647042:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842432 00000100:00100000:3.0:1789479937.647046:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842432 00010000:00010000:3.0:1789479937.647059:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479937.647075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479937.647080:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa24b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527842432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789479937.647086:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789479937.647090:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.647098:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 24 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479937.647119:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789479937.647149:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa24b1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527842432:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479937.647155:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479937.648533:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527842432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789479937.649460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527842176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789479937.651369:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81475000/0xdaa289fda243d100 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d0f9 expref: 23 pid: 6515 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479937.651411:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841664:0@lo:104: 00010000:00010000:2.0:1789479937.651519:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81475400/0xdaa289fda243cfda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cfd3 expref: 22 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479937.651541:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841792:0@lo:104: 00010000:00010000:2.0:1789479937.651555:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243cf86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf7f expref: 21 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479937.651566:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841920:0@lo:104: 00010000:00010000:2.0:1789479937.651577:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81475a00/0xdaa289fda243cf78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243cf71 expref: 20 pid: 6512 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479937.651584:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527842048:0@lo:104: 00000100:00100000:1.0:1789479937.652939:0:10396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10396:1876405527841536:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789479937.652978:0:10396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479937.653568:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479937.653627:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857408 00000100:00100000:3.0:1789479937.653637:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857408 00010000:00010000:3.0:1789479937.653677:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479937.653779:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1789479937.653791:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507857408:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789479937.653807:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789479937.653813:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653825:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653840:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d299d expref: 10 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653857:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653865:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653881:0:9525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653888:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653894:0:9525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653900:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653929:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789479937.653934:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653943:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653963:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479937.653973:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789479937.654045:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:2401:x1876405507857408:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 256us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479937.654053:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00010000:00010000:1.0:1789479937.654366:0:10396:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.654376:0:10396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479937.654390:0:10396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bda00/0xdaa289fda243d2dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479938.244511:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479938.244532:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527842688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789479938.244599:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479938.244787:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842688 00000100:00100000:0.0:1789479938.244795:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842688 00000100:00100000:0.0:1789479938.244842:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789479938.244851:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527842688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789479938.244878:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479938.244942:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527842688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479938.244949:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789479938.244958:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527842688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479938.244977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527842688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789479938.244999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479938.245276:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527842816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479938.245303:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479938.245449:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842816 00000100:00100000:2.0:1789479938.245454:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842816 00000100:00080000:3.0:1789479938.245475:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479938.245506:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789479938.245514:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527842816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479938.245525:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479938.245565:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527842816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479938.245571:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789479938.245593:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1c700 x1876405527842816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479938.245608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527842816:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789479938.373105:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479938.756961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527842944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789479938.757024:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479938.757215:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527842944 00000100:00100000:0.0:1789479938.757223:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527842944 00000100:00100000:0.0:1789479938.757267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789479938.757277:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527842944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789479938.757320:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479938.757390:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527842944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479938.757398:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789479938.757699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527842944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789479939.298997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479939.299094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857536 00000100:00100000:0.0:1789479939.299103:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857536 00000100:00100000:0.0:1789479939.299476:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:0.0:1789479939.299487:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:6182:x1876405507857536:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479939.299504:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789479939.299522:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d29e3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.299549:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.299561:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.299570:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81487200, rc 0) 00000100:00100000:0.0:1789479939.299626:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507857536:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 141us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.299633:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:2.0:1789479939.313859:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479939.314007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857664 00000100:00100000:3.0:1789479939.314017:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857664 00000100:00100000:3.0:1789479939.314069:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:3.0:1789479939.314078:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507857664:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479939.314231:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507857664:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 153us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.314239:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:1.0:1789479939.322533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479939.322609:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857792 00000100:00100000:2.0:1789479939.322619:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857792 00000100:00100000:2.0:1789479939.322680:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:2.0:1789479939.322698:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507857792:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.322842:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6182:x1876405507857792:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.322850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:2.0:1789479939.342599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479939.346369:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507857920 00000100:00100000:3.0:1789479939.346384:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507857920 00000100:00100000:3.0:1789479939.346479:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:3.0:1789479939.346489:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6737:x1876405507857920:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789479939.346648:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6737:x1876405507857920:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 151us (4046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.346655:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:2.0:1789479939.356960:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479939.357042:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858048 00000100:00100000:0.0:1789479939.357051:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858048 00000100:00100000:0.0:1789479939.357135:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 257 00000100:00100000:0.0:1789479939.357145:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6737:x1876405507858048:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789479939.357298:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:6737:x1876405507858048:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 155us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.357316:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 257 00010000:00010000:1.0:1789479939.408485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789479939.588572:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789479939.588579:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8800 from 4 10000000:01000000:3.0:1789479939.588584:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789479939.588630:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479939.588643:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479939.588654:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789479939.588754:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789479939.588817:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479939.588873:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987891780 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.588933:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843072 00000100:00100000:2.0:1789479939.588941:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843072 00000100:00100000:2.0:1789479939.588995:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789479939.589005:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527843072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479939.589018:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479939.589030:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d2ea expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.589051:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.589060:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.589068:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789479939.589115:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.589131:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789479939.589380:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479939.589396:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.589405:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479939.589464:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.589490:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.589521:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330240 going to sleep for 11 seconds 00000100:00100000:3.0:1789479939.589735:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843200 00000100:00100000:3.0:1789479939.589740:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843200 00000100:00100000:3.0:1789479939.589770:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789479939.589778:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789479939.589885:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.589892:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789479939.590150:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.590182:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.590246:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.590263:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330240 going to sleep for 11 seconds 00000100:00100000:3.0:1789479939.590276:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843328 00000100:00100000:3.0:1789479939.590281:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843328 00000100:00100000:3.0:1789479939.590321:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789479939.590328:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789479939.590573:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.590579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789479939.595876:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.598835:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10465:1876405527843456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479939.600476:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479939.600530:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789479939.600589:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843456 00000100:00100000:3.0:1789479939.600598:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843456 00000100:00100000:3.0:1789479939.600655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789479939.600665:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:10465:x1876405527843456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479939.600829:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:10465:x1876405527843456:12345-0@lo:502:llog_process_th.0 Request processed in 164us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.600837:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789479939.606412:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10465:1876405527843456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479939.606452:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479939.606464:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479939.606466:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789479939.606473:0:10465:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6abb3b8800 00000020:00000080:0.0:1789479939.606475:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789479939.606603:0:10465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10465:1876405527843584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.606670:0:10465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.606745:0:10465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330240 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.609289:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843584 00000100:00100000:2.0:1789479939.609299:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843584 00000100:00100000:2.0:1789479939.611724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789479939.611740:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:10465:x1876405527843584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479939.611897:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:10465:x1876405527843584:12345-0@lo:502:llog_process_th.0 Request processed in 162us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.611905:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789479939.612029:0:10465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10465:1876405527843584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479939.612061:0:10465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479939.612068:0:10465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479939.612070:0:10465:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789479939.612074:0:10465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789479939.619421:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789479939.619461:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479939.619472:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.619485:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479939.619494:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789479939.619496:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8000 from 4 10000000:01000000:0.0:1789479939.619499:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789479939.619533:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.619541:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.619550:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479939.619572:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.619631:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.619669:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.621783:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843712 00000100:00100000:2.0:1789479939.621794:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843712 00000100:00100000:2.0:1789479939.621847:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789479939.621856:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527843712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479939.621872:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789479939.621888:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d2f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.621925:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.621937:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.621946:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047bc00, rc 0) 00000100:00100000:2.0:1789479939.622011:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527843712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (2380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.622017:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789479939.622065:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789479939.622087:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789479939.622096:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789479939.622163:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.622213:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479939.622232:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.622246:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843840 00000100:00100000:2.0:1789479939.622250:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843840 00000100:00100000:2.0:1789479939.622274:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789479939.622280:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527843840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.622395:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527843840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.622401:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789479939.622429:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.622453:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.622488:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479939.622500:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.622510:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527843968 00000100:00100000:2.0:1789479939.622513:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527843968 00000100:00100000:2.0:1789479939.622527:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789479939.622532:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527843968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789479939.622604:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527843968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.622619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789479939.622659:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527843968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.627532:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10468:1876405527844096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479939.627607:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.627647:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894da900 going to sleep for 11 seconds 00000100:00100000:2.0:1789479939.627702:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844096 00000100:00100000:2.0:1789479939.627819:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844096 00000100:00100000:2.0:1789479939.627863:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789479939.627871:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:10468:x1876405527844096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789479939.628002:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:10468:x1876405527844096:12345-0@lo:502:llog_process_th.0 Request processed in 131us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479939.628009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789479939.628092:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10468:1876405527844096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479939.628119:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479939.628127:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479939.628130:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789479939.628136:0:10468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6abb3b8000 00000020:00000080:1.0:1789479939.628138:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789479939.628233:0:10468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10468:1876405527844224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479939.628264:0:10468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.628276:0:10468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479939.628390:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844224 00000100:00100000:0.0:1789479939.628395:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844224 00000100:00100000:0.0:1789479939.628419:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789479939.628425:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:10468:x1876405527844224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.630379:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:10468:x1876405527844224:12345-0@lo:502:llog_process_th.0 Request processed in 1947us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.630390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789479939.635373:0:10468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10468:1876405527844224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479939.635417:0:10468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479939.635426:0:10468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479939.635429:0:10468:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789479939.635442:0:10468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789479939.636106:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789479939.636134:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479939.636144:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.636156:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479939.636166:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789479939.636169:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a866ce000 from 4 10000000:01000000:0.0:1789479939.636171:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789479939.636238:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.636248:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.636257:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479939.636278:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.636346:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.636383:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330240 going to sleep for 11 seconds 00000100:00100000:3.0:1789479939.636498:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844352 00000100:00100000:3.0:1789479939.638297:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844352 00000100:00100000:3.0:1789479939.638367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789479939.638376:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527844352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789479939.638389:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479939.638405:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d306 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479939.638431:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d306 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479939.638442:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d306 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479939.638459:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7400, rc 0) 00000100:00100000:3.0:1789479939.638519:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.638526:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789479939.639610:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479939.639631:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479939.639642:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789479939.639728:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.640057:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.640096:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479939.640150:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844480 00000100:00100000:0.0:1789479939.640167:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844480 00000100:00100000:0.0:1789479939.640229:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789479939.640238:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.640384:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.640391:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789479939.641156:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.641228:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.641551:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.641573:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789479939.641636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844608 00000100:00100000:0.0:1789479939.641648:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844608 00000100:00100000:0.0:1789479939.641686:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789479939.641702:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.642080:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 385us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.642087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789479939.642482:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.643613:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10469:1876405527844736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479939.643671:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.643715:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789479939.644300:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844736 00000100:00100000:3.0:1789479939.644308:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844736 00000100:00100000:3.0:1789479939.644455:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789479939.644465:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:10469:x1876405527844736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789479939.644579:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:10469:x1876405527844736:12345-0@lo:502:llog_process_th.0 Request processed in 114us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479939.644586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789479939.645031:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10469:1876405527844736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479939.645062:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789479939.645071:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479939.645074:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789479939.645080:0:10469:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6a866ce000 00000020:00000080:1.0:1789479939.645083:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789479939.645171:0:10469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10469:1876405527844864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479939.645235:0:10469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479939.647074:0:10469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a894dab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789479939.647375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844864 00000100:00100000:0.0:1789479939.647385:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844864 00000100:00100000:0.0:1789479939.647425:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789479939.647434:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:10469:x1876405527844864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.647599:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:10469:x1876405527844864:12345-0@lo:502:llog_process_th.0 Request processed in 165us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.647607:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789479939.648051:0:10469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10469:1876405527844864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789479939.648084:0:10469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789479939.648092:0:10469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789479939.648094:0:10469:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789479939.648098:0:10469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789479939.648564:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789479939.648585:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789479939.648594:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.648605:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789479939.648615:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789479939.648617:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a83cfb000 from 4 10000000:01000000:0.0:1789479939.648620:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789479939.648651:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.648659:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.648681:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479939.648711:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.648750:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.648799:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479939.649130:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527844992 00000100:00100000:1.0:1789479939.649137:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527844992 00000100:00100000:1.0:1789479939.649166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789479939.649173:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527844992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789479939.649185:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479939.649228:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d314 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479939.649261:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d314 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479939.649272:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d314 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479939.649279:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bcc00, rc 0) 00000100:00100000:1.0:1789479939.649312:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527844992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479939.649318:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789479939.649618:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527844992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789479939.649632:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789479939.649640:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789479939.649705:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527845120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.649732:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.649758:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479939.650276:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845120 00000100:00100000:1.0:1789479939.650282:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845120 00000100:00100000:1.0:1789479939.650309:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789479939.650316:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527845120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.650465:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527845120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479939.650472:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789479939.650718:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527845120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.650755:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527845248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.650808:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.651153:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789479939.651300:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845248 00000100:00100000:1.0:1789479939.651305:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845248 00000100:00100000:1.0:1789479939.651331:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789479939.651339:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527845248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789479939.651436:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527845248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479939.651443:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789479939.651709:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527845248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789479939.652629:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10470:1876405527845376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.652682:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.652727:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789479939.653074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845376 00000100:00100000:1.0:1789479939.653081:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845376 00000100:00100000:1.0:1789479939.653110:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789479939.653186:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:10470:x1876405527845376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789479939.653522:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:10470:x1876405527845376:12345-0@lo:502:llog_process_th.0 Request processed in 338us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479939.653529:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789479939.653620:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10470:1876405527845376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479939.653645:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789479939.653653:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479939.653656:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789479939.653661:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6a83cfb000 00000020:00000080:0.0:1789479939.653664:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789479939.653744:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10470:1876405527845504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.654064:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479939.654087:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789479939.654211:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845504 00000100:00100000:1.0:1789479939.654217:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845504 00000100:00100000:1.0:1789479939.654238:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789479939.654244:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:10470:x1876405527845504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789479939.654590:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:10470:x1876405527845504:12345-0@lo:502:llog_process_th.0 Request processed in 345us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479939.654597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789479939.654634:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:10470:1876405527845504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789479939.654655:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789479939.654661:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789479939.654662:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789479939.654666:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789479939.655212:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789479939.655232:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789479939.655241:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479939.655334:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479940.420321:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479940.805141:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479940.805160:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527845632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479940.805232:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479940.806272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845632 00000100:00100000:3.0:1789479940.806282:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845632 00000100:00100000:3.0:1789479940.806341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789479940.806350:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527845632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479940.806392:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479940.806506:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527845632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 157us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.806513:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789479940.807277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527845632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479940.808746:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527845888:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.808804:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.808840:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527846400:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.808858:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.808879:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789479940.808884:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527845760:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.808926:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.808944:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527846272:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.808965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.808993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845888 00000100:00100000:2.0:1789479940.808999:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845888 00000100:00100000:2.0:1789479940.809029:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846400 00000100:00100000:2.0:1789479940.809031:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846400 00000100:00100000:2.0:1789479940.809062:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846272 00000100:00100000:2.0:1789479940.809064:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846272 00000100:00100000:2.0:1789479940.809089:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789479940.809097:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527845888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.809138:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527845888:12345-0@lo:400:kworker.0 Request processed in 41us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479940.809144:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789479940.809157:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789479940.809163:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527846400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.809184:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527846400:12345-0@lo:400:kworker.0 Request processed in 21us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479940.809214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789479940.809224:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789479940.809230:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527846272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.809253:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527846272:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479940.809258:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789479940.809279:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479940.809282:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789479940.809324:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527846272:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.809333:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527845888:0@lo:400:kworker.0 00010000:00080000:2.0:1789479940.809343:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0df80 x1876405527846400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479940.809353:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527846400:0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.809719:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527846016:0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.809748:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479940.809783:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527846528:0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.809803:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479940.809817:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479940.809822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527846144:0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.809838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479940.809976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527845760 00000100:00100000:0.0:1789479940.809982:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527845760 00000100:00100000:0.0:1789479940.811023:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789479940.811037:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527845760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.811105:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527845760:12345-0@lo:400:kworker.0 Request processed in 73us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479940.811112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789479940.811184:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527845760:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.811823:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527847040:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.811861:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479940.811883:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789479940.811889:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527846656:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.811917:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479940.811932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527847168:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.811949:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479940.812037:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846016 00000100:00100000:2.0:1789479940.812050:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846016 00000100:00100000:3.0:1789479940.812733:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846528 00000100:00100000:3.0:1789479940.812739:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846528 00000100:00100000:3.0:1789479940.812837:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847040 00000100:00100000:3.0:1789479940.812841:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847040 00000100:00100000:3.0:1789479940.812853:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846656 00000100:00100000:3.0:1789479940.812855:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846656 00000100:00100000:3.0:1789479940.812865:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847168 00000100:00100000:3.0:1789479940.812867:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847168 00000100:00100000:3.0:1789479940.812880:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789479940.812887:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527846528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.812953:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527846528:12345-0@lo:400:kworker.0 Request processed in 66us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.812960:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789479940.812974:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789479940.812979:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527847040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.813005:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527847040:12345-0@lo:400:kworker.0 Request processed in 26us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.813018:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789479940.813029:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479940.813035:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527846656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.813059:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527846656:12345-0@lo:400:kworker.0 Request processed in 25us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.813064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789479940.813072:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789479940.813182:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789479940.813201:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527846016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.813235:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527846016:12345-0@lo:400:kworker.0 Request processed in 47us (3486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479940.813240:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789479940.813282:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846144 00000100:00100000:2.0:1789479940.813286:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846144 00010000:00080000:1.0:1789479940.813883:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0f800 x1876405527846656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479940.813898:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527846656:0@lo:400:kworker.0 00010000:00080000:1.0:1789479940.813921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0df80 x1876405527847040/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479940.813929:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527847040:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.813939:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527846016:0@lo:400:kworker.0 00010000:00080000:1.0:1789479940.813948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0d180 x1876405527846528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479940.813956:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527846528:0@lo:400:kworker.0 00000100:00080000:1.0:1789479940.813994:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479940.813998:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479940.814260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789479940.814267:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527846144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.814475:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527847168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.814515:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527847168:12345-0@lo:400:kworker.0 Request processed in 1438us (2565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.814522:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789479940.814550:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0c700 x1876405527847168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479940.814559:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527847168:0@lo:400:kworker.0 00000100:00100000:2.0:1789479940.819029:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527846144:12345-0@lo:400:kworker.0 Request processed in 4755us (9182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479940.819042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789479940.820158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527846784:0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.820249:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479940.820286:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479940.820305:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527846912:0@lo:400:kworker.0 00000100:00100000:0.0:1789479940.820333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479940.820682:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527846144:0@lo:400:kworker.0 00000100:00100000:1.0:1789479940.825105:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846784 00000100:00100000:1.0:1789479940.825132:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846784 00000100:00100000:1.0:1789479940.825218:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527846912 00000100:00100000:1.0:1789479940.825221:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527846912 00000100:00100000:1.0:1789479940.825247:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789479940.825255:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527846784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.825395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789479940.825404:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527846912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479940.825461:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527846912:12345-0@lo:400:kworker.0 Request processed in 60us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479940.825468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789479940.825507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0ce00 x1876405527846912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479940.825520:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527846912:0@lo:400:kworker.0 00000100:00080000:0.0:1789479940.825613:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479940.825618:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479940.825666:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527846784:12345-0@lo:400:kworker.0 Request processed in 412us (5417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479940.825673:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789479940.826639:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527846784:0@lo:400:kworker.0 00000100:00100000:0.0:1789479941.316967:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527847296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479941.317032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479941.320166:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847296 00000100:00100000:1.0:1789479941.320179:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847296 00000100:00100000:1.0:1789479941.320251:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789479941.320260:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527847296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789479941.320292:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479941.320470:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527847424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479941.320508:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479941.320703:0:8439:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789479941.320712:0:8439:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789479941.320827:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847424 00000100:00100000:2.0:1789479941.320831:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847424 00000100:00100000:2.0:1789479941.320925:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789479941.320933:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527847424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479941.320944:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479941.320978:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527847424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479941.320984:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789479941.321017:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02f100 x1876405527847424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479941.321045:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527847424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479941.324251:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527847296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3985us (7212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479941.324265:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789479941.327507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02fb80 x1876405527847296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479941.327532:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527847296:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789479941.444707:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479942.473422:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479942.486351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479942.486397:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479942.486435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479942.486473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479942.486515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479942.486554:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858688 00000100:00100000:1.0:1789479942.486565:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858688 00000100:00100000:1.0:1789479942.486626:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858560 00000100:00100000:1.0:1789479942.486628:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858560 00000100:00100000:1.0:1789479942.486649:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:1.0:1789479942.486666:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858688:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479942.486770:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858688:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479942.486779:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:1.0:1789479942.486958:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1789479942.486965:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858560:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479942.486991:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858560:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479942.486997:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00080000:1.0:1789479942.487015:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789479942.487020:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789479942.487386:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858176 00000100:00100000:2.0:1789479942.487393:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858176 00000100:00100000:2.0:1789479942.487447:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 279 00000100:00100000:2.0:1789479942.487456:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2402:x1876405507858176:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479942.487503:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2402:x1876405507858176:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 48us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479942.487510:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 279 00000100:00100000:3.0:1789479942.487665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858432 00000100:00100000:3.0:1789479942.487671:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858432 00000100:00100000:3.0:1789479942.487727:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858304 00000100:00100000:3.0:1789479942.487730:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858304 00000100:00100000:3.0:1789479942.487756:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789479942.487763:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858432:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479942.487796:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507858432:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479942.487802:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789479942.487814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:3.0:1789479942.487820:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507858304:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479942.487841:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507858304:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479942.487847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00080000:0.0:1789479942.487971:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479942.487975:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789479943.366364:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479943.366391:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527847552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479943.366458:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479943.366907:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847552 00000100:00100000:2.0:1789479943.366915:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847552 00000100:00100000:2.0:1789479943.367519:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789479943.367530:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527847552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479943.367560:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479943.367613:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527847552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479943.367620:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789479943.367660:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527847552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479943.367678:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527847552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789479943.368023:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479943.368175:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527847680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479943.368473:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479943.368537:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847680 00000100:00100000:3.0:1789479943.368554:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847680 00000100:00100000:3.0:1789479943.368605:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789479943.368618:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527847680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789479943.368632:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789479943.371240:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789479943.388535:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527847680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 19914us (20053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479943.388556:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789479943.389429:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0a80 x1876405527847680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479943.389459:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527847680:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789479943.494149:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479943.880101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479943.880123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527847808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789479943.880186:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479943.880337:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847808 00000100:00100000:0.0:1789479943.880345:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847808 00000100:00100000:0.0:1789479943.880399:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789479943.880408:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527847808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789479943.880437:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479943.880485:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527847808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479943.880492:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789479943.880534:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527847808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789479944.517281:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789479945.193650:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789479945.541747:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479945.926183:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527848320:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.926267:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.926315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527848832:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527848064:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926433:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926449:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527848576:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926464:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926475:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527849088:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926489:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926512:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789479945.926518:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527848192:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926547:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926563:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527848704:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926591:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527849216:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479945.926629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848320 00000100:00100000:2.0:1789479945.926636:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848320 00000100:00100000:2.0:1789479945.926668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848064 00000100:00100000:2.0:1789479945.926671:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848064 00000100:00100000:2.0:1789479945.926680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848576 00000100:00100000:2.0:1789479945.926682:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848576 00000100:00100000:2.0:1789479945.926699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849088 00000100:00100000:2.0:1789479945.926701:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849088 00000100:00100000:2.0:1789479945.926711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848704 00000100:00100000:2.0:1789479945.926713:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848704 00000100:00100000:2.0:1789479945.926725:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849216 00000100:00100000:2.0:1789479945.926727:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849216 00000100:00100000:2.0:1789479945.926757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789479945.926766:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527848320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926808:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527848320:12345-0@lo:400:kworker.0 Request processed in 43us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.926827:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789479945.926845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789479945.926850:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527848064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926891:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527848064:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.926897:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789479945.926908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789479945.926915:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527848576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926938:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527848576:12345-0@lo:400:kworker.0 Request processed in 25us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.926944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789479945.926953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789479945.926958:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527849088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.926979:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527849088:12345-0@lo:400:kworker.0 Request processed in 22us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.926984:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789479945.926995:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789479945.927001:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527848704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927025:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527848704:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.927031:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789479945.927042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789479945.927048:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527849216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927072:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527849216:12345-0@lo:400:kworker.0 Request processed in 25us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.927083:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1789479945.927099:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789479945.927103:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789479945.927125:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0df80 x1876405527848704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479945.927139:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527848704:0@lo:400:kworker.0 00010000:00080000:2.0:1789479945.927149:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f5c00 x1876405527849216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479945.927156:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527849216:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927164:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527848064:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927170:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527848576:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927176:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527849088:0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927239:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848192 00000100:00100000:2.0:1789479945.927242:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848192 00000100:00100000:2.0:1789479945.927264:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479945.927270:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527848192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.927304:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527848192:12345-0@lo:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.927309:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479945.927341:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527848192:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.927894:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.927925:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527849344:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.927946:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.927973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527848320:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.927982:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1789479945.927988:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527847936:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928011:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.928032:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527848448:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928051:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.928074:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527848960:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928091:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.928102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527849472:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928116:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479945.928136:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848832 00000100:00100000:1.0:1789479945.928140:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848832 00000100:00100000:1.0:1789479945.928165:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849344 00000100:00100000:1.0:1789479945.928167:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849344 00000100:00100000:1.0:1789479945.928176:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848960 00000100:00100000:1.0:1789479945.928178:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848960 00000100:00100000:1.0:1789479945.928187:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849472 00000100:00100000:1.0:1789479945.928205:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849472 00000100:00100000:1.0:1789479945.928220:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789479945.928226:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527848832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928261:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527848832:12345-0@lo:400:kworker.0 Request processed in 35us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479945.928267:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789479945.928280:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789479945.928285:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527849344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.928306:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527849344:12345-0@lo:400:kworker.0 Request processed in 21us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479945.928311:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789479945.928321:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789479945.928666:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527847936 00000100:00100000:3.0:1789479945.928670:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527847936 00000100:00100000:0.0:1789479945.928737:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479945.928848:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527848960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479945.942513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789479945.942551:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527847936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479945.942642:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527847936:12345-0@lo:400:kworker.0 Request processed in 113us (14629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479945.942649:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1789479945.948858:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527848960:12345-0@lo:400:kworker.0 Request processed in 553us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479945.948951:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789479945.948974:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527849472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479945.949073:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527849472:12345-0@lo:400:kworker.0 Request processed in 111us (20955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479945.949100:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527849600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479945.949141:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479945.949208:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527848448 00000100:00100000:0.0:1789479945.949215:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527848448 00000100:00100000:0.0:1789479945.949244:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849600 00000100:00100000:0.0:1789479945.949247:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849600 00000100:00100000:0.0:1789479945.949259:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789479945.949264:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527848448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479945.949297:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527848448:12345-0@lo:400:kworker.0 Request processed in 33us (21246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479945.949303:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789479945.949317:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789479945.949322:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527849600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789479945.949361:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789479945.949394:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527849600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479945.949400:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789479945.949451:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527849600:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789479945.949499:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479945.949504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479945.949541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527847936:0@lo:400:kworker.0 00000100:00100000:0.0:1789479945.949552:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527848448:0@lo:400:kworker.0 00010000:00080000:0.0:1789479945.949564:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527848960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479945.949574:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527848960:0@lo:400:kworker.0 00010000:00080000:0.0:1789479945.949583:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866fb480 x1876405527849472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479945.949590:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527849472:0@lo:400:kworker.0 00010000:00080000:0.0:1789479945.949601:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0f800 x1876405527848832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479945.949609:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527848832:0@lo:400:kworker.0 00010000:00080000:0.0:1789479945.949619:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f8a80 x1876405527849344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479945.949627:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527849344:0@lo:400:kworker.0 00000100:00100000:1.0:1789479945.956988:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789479945.958824:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789479946.436605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527849728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479946.436668:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479946.437309:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849728 00000100:00100000:2.0:1789479946.437318:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849728 00000100:00100000:2.0:1789479946.437371:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789479946.437381:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527849728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479946.437410:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479946.437469:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527849728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479946.437476:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789479946.437560:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527849728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479946.437579:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527849728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479946.437892:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527849856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479946.437928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479946.438081:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849856 00000100:00100000:1.0:1789479946.438086:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849856 00000100:00100000:1.0:1789479946.438123:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479946.438131:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527849856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789479946.438142:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479946.438174:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527849856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479946.438181:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1789479946.438308:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02e300 x1876405527849856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479946.438322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527849856:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789479946.566981:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479947.588627:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479947.625326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479947.625377:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479947.625405:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858816 00000100:00100000:1.0:1789479947.625429:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479947.625436:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858816 00000100:00100000:2.0:1789479947.625537:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859072 00000100:00100000:2.0:1789479947.625548:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859072 00000100:00100000:3.0:1789479947.625602:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507858944 00000100:00100000:3.0:1789479947.625610:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507858944 00000100:00100000:2.0:1789479947.625632:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:2.0:1789479947.625650:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507859072:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479947.625677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:3.0:1789479947.625699:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507858944:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479947.625757:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507859072:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 109us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479947.625767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:3.0:1789479947.625793:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507858944:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479947.625803:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00080000:3.0:1789479947.625867:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479947.625884:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789479947.626454:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 281 00000100:00100000:0.0:1789479947.626475:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507858816:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479947.626521:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507858816:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 58us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479947.626536:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 281 00000100:00100000:3.0:1789479947.629888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479947.629935:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479947.629963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859200 00000100:00100000:3.0:1789479947.629972:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859200 00000100:00100000:3.0:1789479947.630025:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859328 00000100:00100000:3.0:1789479947.630028:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859328 00000100:00100000:3.0:1789479947.630063:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1789479947.630073:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2398:x1876405507859200:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1789479947.630103:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d22d 00000100:00080000:3.0:1789479947.630122:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6985dae800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789479947.630158:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789479947.630299:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+2:2398:x1876405507859200:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 226us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479947.630306:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1789479947.630319:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1789479947.630325:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2398:x1876405507859328:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1789479947.630337:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d234 00000100:00080000:3.0:1789479947.630342:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6987e13000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789479947.630360:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789479947.630415:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+2:2398:x1876405507859328:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 89us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479947.630421:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00010000:00010000:3.0:1789479947.630436:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479947.630458:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789479947.630466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479947.630477:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479948.484611:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479948.485822:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527850112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479948.485919:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479948.487478:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850112 00000100:00100000:2.0:1789479948.487501:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850112 00000100:00100000:2.0:1789479948.487588:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789479948.487601:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527850112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789479948.487652:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789479948.487893:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479948.488413:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527850112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 815us (2493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479948.488422:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789479948.488601:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527850112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479948.488639:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527850112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789479948.494844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527849984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479948.494955:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479948.495159:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527849984 00000100:00100000:0.0:1789479948.495178:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527849984 00000100:00100000:0.0:1789479948.495284:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789479948.495295:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527849984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479948.495325:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479948.495384:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527849984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479948.495392:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789479948.495507:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479948.495651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbce00 x1876405527849984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479948.495676:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527849984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789479948.613923:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479949.002651:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527850240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789479949.002734:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479949.002824:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850240 00000100:00100000:3.0:1789479949.002834:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850240 00000100:00100000:3.0:1789479949.002897:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789479949.002906:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527850240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479949.002947:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479949.002998:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527850240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479949.003017:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789479949.003072:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527850240:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789479949.638042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479950.663877:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479951.049437:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479951.049458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527850368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479951.049520:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.049585:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850368 00000100:00100000:3.0:1789479951.049594:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850368 00000100:00100000:3.0:1789479951.049703:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789479951.049712:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527850368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479951.049740:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479951.049781:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527850368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.049788:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789479951.049830:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527850368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789479951.052567:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479951.052650:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479951.052669:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527850880:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.052729:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.052779:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527850624:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.052803:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.052822:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479951.052828:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527850752:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.052862:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.052896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850880 00000100:00100000:3.0:1789479951.052903:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850880 00000100:00100000:3.0:1789479951.052947:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850624 00000100:00100000:3.0:1789479951.052950:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850624 00000100:00100000:3.0:1789479951.052968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789479951.052977:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527850880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.053025:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527850880:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.053031:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789479951.053046:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789479951.053052:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527850624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.053080:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527850624:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.053086:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789479951.053104:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850752 00000100:00100000:3.0:1789479951.053107:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850752 00000100:00100000:3.0:1789479951.053131:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789479951.053138:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527850752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.053173:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527850752:12345-0@lo:400:kworker.0 Request processed in 36us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.053180:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789479951.053248:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527850880:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.053277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527850752:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.053289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527850624:0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.057760:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527850496:0@lo:400:kworker.0 00000100:00100000:0.0:1789479951.057825:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479951.058726:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527851008:0@lo:400:kworker.0 00000100:00100000:2.0:1789479951.058766:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.058779:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527850496 00000100:00100000:3.0:1789479951.058787:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527850496 00000100:00100000:2.0:1789479951.058807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851008 00000100:00100000:2.0:1789479951.058813:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851008 00000100:00100000:3.0:1789479951.058833:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789479951.058843:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527850496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479951.058867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789479951.058877:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527851008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.058916:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527850496:12345-0@lo:400:kworker.0 Request processed in 75us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479951.058926:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527851008:12345-0@lo:400:kworker.0 Request processed in 51us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479951.058936:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789479951.058939:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1789479951.058963:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479951.059002:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527851008:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059014:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527851136:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059043:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.059085:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527850496:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479951.059141:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527851264:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059167:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.059211:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851264 00000100:00100000:3.0:1789479951.059215:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851264 00000100:00100000:3.0:1789479951.059247:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789479951.059254:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527851264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059289:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527851264:12345-0@lo:400:kworker.0 Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.059295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789479951.059329:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4e680 x1876405527851264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479951.059339:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527851264:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.059390:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789479951.059403:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527851648:0@lo:400:kworker.0 00000100:00100000:3.0:1789479951.059412:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479951.059421:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527851776:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.059438:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.059453:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.059491:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851136 00000100:00100000:1.0:1789479951.059501:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851136 00000100:00100000:3.0:1789479951.059516:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527851520:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.059530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851648 00000100:00100000:1.0:1789479951.059535:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851648 00000100:00100000:3.0:1789479951.059544:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479951.059582:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851520 00000100:00100000:2.0:1789479951.059587:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851520 00000100:00100000:1.0:1789479951.061271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789479951.061288:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527851136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061364:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527851136:12345-0@lo:400:kworker.0 Request processed in 83us (2320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.061372:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789479951.061387:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789479951.061395:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527851648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061428:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527851648:12345-0@lo:400:kworker.0 Request processed in 35us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.061434:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789479951.061445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789479951.061453:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527851520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061722:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527851520:12345-0@lo:400:kworker.0 Request processed in 270us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.061729:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789479951.061772:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbce00 x1876405527851648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479951.061786:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527851648:0@lo:400:kworker.0 00010000:00080000:1.0:1789479951.061818:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4c380 x1876405527851136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479951.061828:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527851136:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061847:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527851392:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061902:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.061929:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527851904:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.061948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479951.061968:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851776 00000100:00100000:1.0:1789479951.061974:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851776 00000100:00100000:1.0:1789479951.062004:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851392 00000100:00100000:1.0:1789479951.062006:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851392 00000100:00100000:1.0:1789479951.062020:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527851904 00000100:00100000:1.0:1789479951.062022:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527851904 00000100:00100000:1.0:1789479951.062034:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479951.062040:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527851776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.062073:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527851776:12345-0@lo:400:kworker.0 Request processed in 33us (2621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.062080:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789479951.062092:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479951.062097:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527851392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.062122:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527851392:12345-0@lo:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.062127:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789479951.062139:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789479951.062661:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527851520:0@lo:400:kworker.0 00000100:00100000:1.0:1789479951.062668:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527851904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789479951.062688:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479951.062700:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479951.062703:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479951.062706:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479951.062713:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527851904:12345-0@lo:400:kworker.0 Request processed in 567us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479951.062720:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789479951.062757:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527851776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479951.062768:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527851776:0@lo:400:kworker.0 00010000:00080000:1.0:1789479951.062806:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d49880 x1876405527851904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479951.062814:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527851904:0@lo:400:kworker.0 00010000:00080000:1.0:1789479951.062826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4e680 x1876405527851392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479951.062833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527851392:0@lo:400:kworker.0 00000100:00100000:2.0:1789479951.557366:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479951.557387:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479951.557449:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479951.557515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852032 00000100:00100000:2.0:1789479951.557522:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852032 00000100:00100000:2.0:1789479951.557565:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789479951.557574:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527852032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479951.557602:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479951.558184:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527852032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 610us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479951.558230:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789479951.558279:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0d180 x1876405527852032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479951.558296:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527852032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479951.559831:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527852160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479951.560528:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479951.560649:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852160 00000100:00100000:3.0:1789479951.560657:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852160 00000100:00100000:3.0:1789479951.560707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789479951.560717:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527852160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789479951.560742:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479951.560789:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527852160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479951.560796:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789479951.560831:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d48380 x1876405527852160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479951.560867:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527852160:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789479951.685749:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479952.709550:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479952.734428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479952.734475:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479952.734497:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479952.734520:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859584 00000100:00100000:3.0:1789479952.734528:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859584 00000100:00100000:3.0:1789479952.734571:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859712 00000100:00100000:3.0:1789479952.734573:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859712 00000100:00100000:3.0:1789479952.734595:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:3.0:1789479952.734613:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507859584:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479952.734674:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507859584:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479952.734681:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:3.0:1789479952.734697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:3.0:1789479952.734709:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507859712:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479952.734732:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507859712:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479952.734738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:3.0:1789479952.734753:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859456 00000100:00100000:3.0:1789479952.734756:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859456 00000100:00100000:3.0:1789479952.734775:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00100000:3.0:1789479952.734781:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507859456:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479952.734800:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507859456:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 19us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479952.734806:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00080000:3.0:1789479952.734828:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479952.734832:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789479953.102676:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:0.0:1789479953.102686:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6987e14800/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:2.0:1789479953.103784:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e14800/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-OST0001 00000020:00000080:2.0:1789479953.103850:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e13000 for lustre-OST0001 00000001:00100000:2.0:1789479953.104172:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:2.0:1789479953.104176:0:8430:0:(genops.c:885:class_export_put()) final put ffff8a6985dae000/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:2.0:1789479953.104207:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6985dae000/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-OST0000 00000020:00000080:2.0:1789479953.104230:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6985dae800 for lustre-OST0000 00000100:00100000:0.0:1789479953.604769:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479953.604791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527852288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479953.604864:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479953.604922:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852288 00000100:00100000:0.0:1789479953.604929:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852288 00000100:00100000:0.0:1789479953.604984:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789479953.604993:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527852288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789479953.605018:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479953.605056:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527852288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479953.605063:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1789479953.605081:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789479953.605108:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d2b800 x1876405527852288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479953.605125:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527852288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789479953.606333:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479953.606346:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527852416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479953.606384:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479953.606427:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852416 00000100:00100000:3.0:1789479953.606433:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852416 00000100:00100000:3.0:1789479953.606469:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479953.606476:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527852416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479953.606491:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479953.606526:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527852416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479953.606533:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789479953.606548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789479953.606569:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4b100 x1876405527852416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479953.606589:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527852416:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789479953.695175:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing yml_node 00010000:00010000:1.0:1789479953.737475:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479954.116538:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479954.116559:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527852544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789479954.116617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479954.117986:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852544 00000100:00100000:3.0:1789479954.117996:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852544 00000100:00100000:3.0:1789479954.118049:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789479954.118058:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527852544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479954.118090:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479954.118161:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527852544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479954.118168:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789479954.118298:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527852544:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789479954.757328:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789479955.792985:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479956.164703:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527852800:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.164774:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.164842:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527853312:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.164863:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.164885:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527853824:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.164901:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.164925:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789479956.164931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527852672:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.164953:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.164971:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527853184:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.164990:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165005:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527853696:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165025:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165051:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854208:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165072:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527852928:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165119:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527853440:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165172:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527853952:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165226:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165240:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789479956.165246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527853056:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165276:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527853568:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165308:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527854080:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165323:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.165350:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852800 00000100:00100000:3.0:1789479956.165356:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852800 00000100:00100000:3.0:1789479956.165388:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853312 00000100:00100000:3.0:1789479956.165390:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853312 00000100:00100000:3.0:1789479956.165411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853824 00000100:00100000:3.0:1789479956.165414:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853824 00000100:00100000:3.0:1789479956.165425:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853440 00000100:00100000:3.0:1789479956.165427:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853440 00000100:00100000:3.0:1789479956.165437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853952 00000100:00100000:3.0:1789479956.165439:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853952 00000100:00100000:3.0:1789479956.165449:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853056 00000100:00100000:3.0:1789479956.165451:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853056 00000100:00100000:3.0:1789479956.165463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789479956.165477:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527852800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165524:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527852800:12345-0@lo:400:kworker.0 Request processed in 48us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789479956.165547:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789479956.165553:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527853312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165577:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527853312:12345-0@lo:400:kworker.0 Request processed in 24us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165582:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789479956.165591:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789479956.165597:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527853824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165620:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527853824:12345-0@lo:400:kworker.0 Request processed in 23us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789479956.165636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789479956.165642:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527853440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165669:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527853440:12345-0@lo:400:kworker.0 Request processed in 28us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789479956.165685:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789479956.165691:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527853952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165714:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527853952:12345-0@lo:400:kworker.0 Request processed in 23us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789479956.165731:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789479956.165743:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527853056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165771:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527853056:12345-0@lo:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165777:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789479956.165801:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852672 00000100:00100000:3.0:1789479956.165804:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852672 00000100:00100000:3.0:1789479956.165843:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789479956.165849:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527852672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.165878:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527852672:12345-0@lo:400:kworker.0 Request processed in 29us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.165884:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789479956.165906:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853184 00000100:00100000:3.0:1789479956.165909:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853184 00000100:00100000:3.0:1789479956.165928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527852928 00000100:00100000:3.0:1789479956.165930:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527852928 00000100:00100000:3.0:1789479956.165941:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789479956.165947:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527853184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.165949:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853696 00000100:00100000:2.0:1789479956.165953:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853696 00000100:00100000:2.0:1789479956.165972:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854208 00000100:00100000:3.0:1789479956.165975:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527853184:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479956.165975:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854208 00000100:00100000:3.0:1789479956.165980:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789479956.165985:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527853568 00000100:00100000:2.0:1789479956.165987:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527853568 00000100:00100000:3.0:1789479956.165990:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789479956.165995:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527852928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.165997:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854080 00000100:00100000:2.0:1789479956.165999:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854080 00000100:00100000:2.0:1789479956.166011:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789479956.166017:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527853696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.166018:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527852928:12345-0@lo:400:kworker.0 Request processed in 22us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.166023:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789479956.166039:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789479956.166045:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166047:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527853696:12345-0@lo:400:kworker.0 Request processed in 31us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479956.166053:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789479956.166063:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789479956.166068:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527853568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.166076:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854208:12345-0@lo:400:kworker.0 Request processed in 32us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.166082:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789479956.166088:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527853568:12345-0@lo:400:kworker.0 Request processed in 20us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.166093:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789479956.166098:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527854080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166098:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789479956.166122:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527854080:12345-0@lo:400:kworker.0 Request processed in 24us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.166128:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789479956.166133:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479956.166137:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789479956.166139:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789479956.166141:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479956.166149:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854336:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479956.166159:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527853056:0@lo:400:kworker.0 00010000:00080000:3.0:1789479956.166171:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862fb480 x1876405527853568/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479956.166172:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.166180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527853568:0@lo:400:kworker.0 00010000:00080000:3.0:1789479956.166206:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f9500 x1876405527854080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479956.166215:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527854080:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166216:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527852672:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.166224:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527852928:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166225:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527853184:0@lo:400:kworker.0 00010000:00080000:3.0:1789479956.166234:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f8700 x1876405527853440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789479956.166234:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f8a80 x1876405527853696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479956.166243:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527853440:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166243:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527853696:0@lo:400:kworker.0 00010000:00080000:3.0:1789479956.166252:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862faa00 x1876405527853952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1789479956.166252:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb035180 x1876405527854208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479956.166260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527853952:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166260:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb035180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854208:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166269:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527852800:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166276:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527853312:0@lo:400:kworker.0 00000100:00100000:2.0:1789479956.166284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527853824:0@lo:400:kworker.0 00000100:00100000:3.0:1789479956.166293:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854336 00000100:00100000:3.0:1789479956.166296:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854336 00000100:00100000:3.0:1789479956.166320:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789479956.166325:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479956.166351:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479956.166395:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.166401:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789479956.166631:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479956.678261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527854464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479956.678329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479956.678576:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479956.678596:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527854592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479956.678635:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479956.679416:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854464 00000100:00100000:3.0:1789479956.679426:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854464 00000100:00100000:3.0:1789479956.679475:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854592 00000100:00100000:3.0:1789479956.679478:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854592 00000100:00100000:3.0:1789479956.679496:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479956.679505:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527854464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789479956.679535:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479956.679611:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527854464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.679618:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789479956.679645:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789479956.679651:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527854592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789479956.679661:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479956.679685:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527854592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479956.679690:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789479956.680652:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0d180 x1876405527854592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479956.680672:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527854592:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789479956.680687:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb034000 x1876405527854464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479956.680699:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb034000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527854464:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789479956.804573:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479957.831323:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479957.849043:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479957.849091:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479957.849135:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479957.849164:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859840 00000100:00100000:3.0:1789479957.849183:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859840 00000100:00100000:1.0:1789479957.849277:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860096 00000100:00100000:1.0:1789479957.849294:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860096 00000100:00100000:3.0:1789479957.849320:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 285 00000100:00100000:3.0:1789479957.849356:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507859840:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479957.849361:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507859968 00000100:00100000:1.0:1789479957.849367:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507859968 00000100:00100000:1.0:1789479957.849399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:1.0:1789479957.849411:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507860096:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479957.849454:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507859840:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 104us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479957.849464:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 285 00000100:00100000:1.0:1789479957.849492:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507860096:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 81us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479957.849502:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:1.0:1789479957.849525:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:1.0:1789479957.849532:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507859968:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479957.849583:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507859968:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479957.849590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00080000:1.0:1789479957.849611:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789479957.849615:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789479958.724481:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789479958.724503:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479958.724565:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479958.724676:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854720 00000100:00100000:3.0:1789479958.724684:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854720 00000100:00100000:3.0:1789479958.724756:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789479958.724774:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479958.724808:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479958.724864:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527854720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479958.724871:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789479958.724906:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb035c00 x1876405527854720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479958.724924:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527854720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789479958.725422:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479958.729864:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527854848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789479958.729935:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479958.730083:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854848 00000100:00100000:0.0:1789479958.730091:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854848 00000100:00100000:0.0:1789479958.730155:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789479958.730163:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527854848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789479958.730186:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479958.730261:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527854848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479958.730291:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789479958.730330:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb035c00 x1876405527854848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479958.730348:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527854848:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789479958.730465:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789479958.852428:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479959.236490:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479959.236513:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527854976:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789479959.236572:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479959.239774:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527854976 00000100:00100000:2.0:1789479959.239799:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527854976 00000100:00100000:2.0:1789479959.239872:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789479959.239881:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527854976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789479959.239918:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789479959.240042:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527854976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 162us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479959.240059:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789479959.245802:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527854976:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789479959.877695:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479960.902458:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479961.284675:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527855104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479961.284755:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479961.285024:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855104 00000100:00100000:2.0:1789479961.285033:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855104 00000100:00100000:2.0:1789479961.285103:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789479961.285112:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527855104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789479961.285144:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479961.285221:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527855104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479961.285229:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789479961.285632:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527855488:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.285663:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.285684:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527856000:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.285721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.285743:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527856512:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.285947:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.285967:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789479961.285974:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527855616:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.285999:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.286017:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527856128:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.286037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.286055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527856640:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.286073:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479961.286098:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855488 00000100:00100000:1.0:1789479961.286104:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855488 00000100:00100000:1.0:1789479961.286139:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789479961.286147:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527855488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.286186:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527855488:12345-0@lo:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479961.286213:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789479961.286231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855616 00000100:00100000:1.0:1789479961.286234:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855616 00000100:00100000:1.0:1789479961.286258:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789479961.286368:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527855232:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286401:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286425:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527855744:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286476:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527856256:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286495:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286512:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789479961.286519:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527855360:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286538:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286548:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527855872:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286564:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286573:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527856384:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286590:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.286611:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855744 00000100:00100000:0.0:1789479961.286615:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855744 00000100:00100000:0.0:1789479961.286642:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856256 00000100:00100000:0.0:1789479961.286645:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856256 00000100:00100000:0.0:1789479961.286658:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855360 00000100:00100000:0.0:1789479961.286660:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855360 00000100:00100000:0.0:1789479961.286670:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855872 00000100:00100000:0.0:1789479961.286678:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855872 00000100:00100000:0.0:1789479961.286695:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856384 00000100:00100000:0.0:1789479961.286709:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856384 00000100:00100000:0.0:1789479961.286726:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789479961.286731:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527855744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286937:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527855744:12345-0@lo:400:kworker.0 Request processed in 204us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.286944:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789479961.286959:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789479961.286966:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527856256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.286994:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527856256:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.286999:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789479961.287009:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789479961.287014:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527855360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.287039:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527855360:12345-0@lo:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.287044:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789479961.287055:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789479961.287061:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527855872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.287085:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527855872:12345-0@lo:400:kworker.0 Request processed in 25us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.287090:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789479961.287101:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789479961.287107:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527856384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.287132:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527856384:12345-0@lo:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.287144:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1789479961.287164:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479961.287167:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479961.287210:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527855360:0@lo:400:kworker.0 00010000:00080000:0.0:1789479961.287223:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b1c00 x1876405527855872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479961.287234:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527855872:0@lo:400:kworker.0 00010000:00080000:0.0:1789479961.287243:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df480 x1876405527856384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479961.287251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527856384:0@lo:400:kworker.0 00000100:00100000:0.0:1789479961.287260:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527855744:0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287474:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856000 00000100:00100000:2.0:1789479961.287479:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856000 00000100:00100000:2.0:1789479961.287510:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856512 00000100:00100000:2.0:1789479961.287513:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856512 00000100:00100000:2.0:1789479961.287526:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856128 00000100:00100000:2.0:1789479961.287528:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856128 00000100:00100000:2.0:1789479961.287540:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856640 00000100:00100000:2.0:1789479961.287542:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856640 00000100:00100000:2.0:1789479961.287554:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789479961.287560:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527856000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287596:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527856000:12345-0@lo:400:kworker.0 Request processed in 36us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479961.287603:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789479961.287614:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789479961.287620:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527856512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287647:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527856512:12345-0@lo:400:kworker.0 Request processed in 28us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479961.287652:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789479961.287662:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789479961.287667:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527856128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287692:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527856128:12345-0@lo:400:kworker.0 Request processed in 26us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479961.287716:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789479961.287728:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789479961.287733:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527856640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287771:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527856640:12345-0@lo:400:kworker.0 Request processed in 27us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479961.287777:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789479961.287849:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527856128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.287859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527856128:0@lo:400:kworker.0 00010000:00080000:2.0:1789479961.287870:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df800 x1876405527856640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.287879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527856640:0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.287888:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527855488:0@lo:400:kworker.0 00010000:00080000:2.0:1789479961.287897:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b2300 x1876405527856000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.287906:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527856000:0@lo:400:kworker.0 00010000:00080000:2.0:1789479961.287915:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dd880 x1876405527856512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.287923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527856512:0@lo:400:kworker.0 00000100:00080000:2.0:1789479961.287953:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479961.287957:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479961.288206:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.288244:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527855616:12345-0@lo:400:kworker.0 Request processed in 1980us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479961.288251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789479961.288538:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527856256:0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.288669:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527855232 00000100:00100000:3.0:1789479961.288676:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527855232 00000100:00100000:3.0:1789479961.288724:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789479961.288732:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527855232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479961.288788:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527855232:12345-0@lo:400:kworker.0 Request processed in 57us (2386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479961.288795:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789479961.288867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527855104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789479961.290335:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527855232:0@lo:400:kworker.0 00000100:00100000:2.0:1789479961.290614:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527855616:0@lo:400:kworker.0 00000100:00100000:1.0:1789479961.797562:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479961.797649:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479961.797718:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527856896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479961.797778:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479961.797829:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856768 00000100:00100000:3.0:1789479961.797838:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856768 00000100:00100000:3.0:1789479961.797896:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527856896 00000100:00100000:3.0:1789479961.797899:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527856896 00000100:00100000:0.0:1789479961.798092:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789479961.798105:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527856768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789479961.798144:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479961.798326:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527856768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 212us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479961.798334:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789479961.798392:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4b100 x1876405527856768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479961.798414:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527856768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479961.798622:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789479961.798630:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527856896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789479961.798642:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479961.798682:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527856896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479961.798688:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789479961.798723:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb034380 x1876405527856896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479961.798737:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527856896:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479961.925382:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789479962.137646:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789479962.953525:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479962.970261:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479962.970308:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479962.970405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479962.970434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860352 00000100:00100000:0.0:1789479962.970443:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860352 00000100:00100000:0.0:1789479962.970497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860480 00000100:00100000:0.0:1789479962.970501:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860480 00000100:00100000:0.0:1789479962.970526:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:0.0:1789479962.970536:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507860352:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479962.970618:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507860352:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479962.970625:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:0.0:1789479962.970641:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:0.0:1789479962.970648:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507860480:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479962.970673:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507860480:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479962.970679:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00080000:0.0:1789479962.970693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479962.970697:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479962.973506:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860224 00000100:00100000:1.0:1789479962.973519:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860224 00000100:00100000:1.0:1789479962.973578:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 287 00000100:00100000:1.0:1789479962.973588:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507860224:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479962.973666:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507860224:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 79us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479962.973674:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 287 00000100:00100000:3.0:1789479963.844419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479963.844439:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527857024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479963.844504:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479963.844694:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857024 00000100:00100000:0.0:1789479963.844701:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857024 00000100:00100000:0.0:1789479963.844749:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789479963.844757:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527857024:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479963.844762:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479963.844771:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527857152:0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789479963.844785:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479963.844812:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479963.844837:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527857024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479963.844844:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789479963.844847:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857152 00000100:00100000:1.0:1789479963.844850:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857152 00000100:00100000:1.0:1789479963.844875:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789479963.844881:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527857152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789479963.844891:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479963.844923:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527857152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479963.844929:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789479963.849957:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df100 x1876405527857152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479963.849986:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527857152:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789479963.850038:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb034380 x1876405527857024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479963.850051:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527857024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789479963.850084:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789479963.973230:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479964.358625:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789479964.358655:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527857280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789479964.358721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479964.358807:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857280 00000100:00100000:3.0:1789479964.358815:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857280 00000100:00100000:3.0:1789479964.358862:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789479964.358871:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527857280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479964.358903:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479964.358948:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527857280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479964.358955:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789479964.358996:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb034380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527857280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789479964.997365:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789479965.043965:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:1.0:1789479966.028436:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479966.405974:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789479966.405995:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479966.406066:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.406125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857408 00000100:00100000:2.0:1789479966.406131:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857408 00000100:00100000:2.0:1789479966.406170:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789479966.406178:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527857408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789479966.406227:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479966.406265:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527857408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.406272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789479966.407114:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527857408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479966.407826:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527857536:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.407893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.407936:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527858048:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.407962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.408044:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.408066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.408086:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789479966.408091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527857664:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.408109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.408125:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527858176:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.408143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.408158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527858688:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.408176:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479966.408213:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858048 00000100:00100000:3.0:1789479966.408227:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858048 00000100:00100000:2.0:1789479966.409395:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527857792:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409445:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.409539:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857536 00000100:00100000:1.0:1789479966.409548:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857536 00000100:00100000:1.0:1789479966.409594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789479966.409602:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527857536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409684:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527858304:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409707:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.409726:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527858816:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409742:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.409756:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789479966.409761:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527857920:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409805:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.409815:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527858432:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409830:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.409844:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527858944:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.409886:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858304 00000100:00100000:2.0:1789479966.409890:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858304 00000100:00100000:2.0:1789479966.409913:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858816 00000100:00100000:2.0:1789479966.409915:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858816 00000100:00100000:2.0:1789479966.409927:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858432 00000100:00100000:2.0:1789479966.409930:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858432 00000100:00100000:2.0:1789479966.409940:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858944 00000100:00100000:2.0:1789479966.409942:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858944 00000100:00100000:2.0:1789479966.409953:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789479966.409959:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527858304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.409991:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527858304:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.409998:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789479966.410020:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789479966.410026:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527858816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.410051:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527858816:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.410056:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789479966.410066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789479966.410071:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527858432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.410095:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527858432:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.410108:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789479966.410120:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789479966.410125:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527858944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.410152:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527858944:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.410158:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789479966.410207:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df480 x1876405527858432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.410221:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527858432:0@lo:400:kworker.0 00010000:00080000:2.0:1789479966.410231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce4700 x1876405527858944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.410239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527858944:0@lo:400:kworker.0 00010000:00080000:2.0:1789479966.410247:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dc700 x1876405527858304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.410254:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527858304:0@lo:400:kworker.0 00010000:00080000:2.0:1789479966.410261:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce7b80 x1876405527858816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.410268:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527858816:0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.413657:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858560 00000100:00100000:2.0:1789479966.413675:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858560 00000100:00100000:2.0:1789479966.413724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857664 00000100:00100000:2.0:1789479966.413728:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857664 00000100:00100000:2.0:1789479966.413740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858176 00000100:00100000:2.0:1789479966.413742:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858176 00000100:00100000:2.0:1789479966.413765:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527858688 00000100:00100000:2.0:1789479966.413768:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527858688 00000100:00100000:2.0:1789479966.413794:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857920 00000100:00100000:2.0:1789479966.413797:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857920 00000100:00100000:2.0:1789479966.413813:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789479966.413822:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527858560:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789479966.414305:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789479966.414311:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479966.414314:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479966.414317:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479966.414330:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527857792 00000100:00100000:3.0:1789479966.414335:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527857792 00000100:00100000:3.0:1789479966.414367:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789479966.414374:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527857792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.414436:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527857792:12345-0@lo:400:kworker.0 Request processed in 62us (4989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479966.414443:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789479966.414506:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527857792:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.414553:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789479966.414559:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527857664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479966.415310:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527857536:12345-0@lo:400:kworker.0 Request processed in 5704us (7413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.415323:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789479966.415659:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527858560:12345-0@lo:400:kworker.0 Request processed in 1837us (7590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.415668:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789479966.415689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789479966.415700:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.415745:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527858176:12345-0@lo:400:kworker.0 Request processed in 50us (7601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.415751:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789479966.415762:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789479966.415769:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.415809:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527858688:12345-0@lo:400:kworker.0 Request processed in 41us (7632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.415815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789479966.415826:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789479966.415833:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527857920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.415867:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527857920:12345-0@lo:400:kworker.0 Request processed in 35us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.415873:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789479966.415884:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789479966.415890:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527858048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479966.415938:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527858048:12345-0@lo:400:kworker.0 Request processed in 48us (7975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.415944:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789479966.416101:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527857664:12345-0@lo:400:kworker.0 Request processed in 1541us (7989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479966.416109:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789479966.416146:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527857664:0@lo:400:kworker.0 00010000:00080000:3.0:1789479966.416159:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df100 x1876405527858176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479966.416170:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527858176:0@lo:400:kworker.0 00010000:00080000:3.0:1789479966.416182:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df800 x1876405527858688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479966.416214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527858688:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.416248:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527857536:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.416260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527858048:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.416269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527858560:0@lo:400:kworker.0 00000100:00100000:3.0:1789479966.416478:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527857920:0@lo:400:kworker.0 00000100:00100000:0.0:1789479966.916513:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789479966.916547:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527859072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479966.916613:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479966.916746:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859072 00000100:00100000:1.0:1789479966.916755:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859072 00000100:00100000:1.0:1789479966.916819:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789479966.916828:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527859072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479966.916855:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479966.916904:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527859072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479966.916911:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789479966.917027:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527859072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479966.917061:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527859072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479966.917733:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527859200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479966.917783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479966.917906:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859200 00000100:00100000:2.0:1789479966.917912:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859200 00000100:00100000:2.0:1789479966.917949:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789479966.917957:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527859200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789479966.917970:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479966.918016:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527859200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479966.918022:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789479966.918128:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0000 x1876405527859200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479982 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479966.918144:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527859200:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479967.044440:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479968.070136:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479968.089543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479968.089593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479968.089669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479968.092237:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860864 00000100:00100000:2.0:1789479968.092251:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860864 00000100:00100000:2.0:1789479968.092308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860736 00000100:00100000:2.0:1789479968.092312:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860736 00000100:00100000:2.0:1789479968.092337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:2.0:1789479968.092347:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507860864:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479968.092427:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507860864:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 81us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479968.092435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:2.0:1789479968.092465:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:2.0:1789479968.092472:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507860736:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479968.092517:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507860736:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 45us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479968.092525:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:3.0:1789479968.095895:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860608 00000100:00100000:3.0:1789479968.095906:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860608 00000100:00100000:3.0:1789479968.095960:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 289 00000100:00100000:3.0:1789479968.095970:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507860608:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479968.096030:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507860608:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 62us (6496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479968.096038:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 289 00000100:00080000:3.0:1789479968.096067:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479968.096072:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1789479968.538963:0:11322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1789479968.968085:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527859328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479968.968261:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479968.968407:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479968.968417:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527859456:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479968.968446:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479968.968655:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859328 00000100:00100000:3.0:1789479968.968667:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859328 00000100:00100000:3.0:1789479968.968751:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859456 00000100:00100000:3.0:1789479968.968755:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859456 00000100:00100000:3.0:1789479968.968792:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479968.968802:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527859328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789479968.968853:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479968.968922:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527859328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479968.968930:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789479968.968949:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789479968.968955:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527859456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789479968.968987:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479968.969014:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527859456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479968.969029:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789479968.969077:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce7800 x1876405527859456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479968.969100:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527859456:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1789479968.969112:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f8a80 x1876405527859328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479968.969123:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527859328:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789479968.971884:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789479969.094813:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479969.476949:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479969.485368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527859584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789479969.485459:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479969.485621:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859584 00000100:00100000:0.0:1789479969.485630:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859584 00000100:00100000:0.0:1789479969.485676:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789479969.485686:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527859584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789479969.485725:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479969.485788:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527859584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479969.485796:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789479969.485966:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527859584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789479970.117912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789479970.378171:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 15 09:46:08 EDT 2026 00010000:00010000:0.0:1789479971.144786:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479971.529781:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527860096:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.529912:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530004:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527860608:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530038:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530065:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527861120:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530087:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530114:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789479971.530120:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527859712:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530162:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530208:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527860224:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527860736:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530279:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530295:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527861248:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530356:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527859840:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530382:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530399:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527860352:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530419:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530433:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527860864:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530453:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530469:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789479971.530474:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527859968:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530496:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530514:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527860480:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530545:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527860992:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530577:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479971.530717:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859712 00000100:00100000:0.0:1789479971.530727:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859712 00000100:00100000:0.0:1789479971.530806:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789479971.530816:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527859712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.530880:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527859712:12345-0@lo:400:kworker.0 Request processed in 65us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.530889:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789479971.530928:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860224 00000100:00100000:0.0:1789479971.530932:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860224 00000100:00100000:0.0:1789479971.530962:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859968 00000100:00100000:0.0:1789479971.530965:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859968 00000100:00100000:0.0:1789479971.530980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789479971.530986:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527860224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531022:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527860224:12345-0@lo:400:kworker.0 Request processed in 37us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531027:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789479971.531038:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789479971.531044:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527859968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531077:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527859968:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531083:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789479971.531102:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860608 00000100:00100000:0.0:1789479971.531106:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860608 00000100:00100000:0.0:1789479971.531135:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861120 00000100:00100000:0.0:1789479971.531146:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861120 00000100:00100000:0.0:1789479971.531164:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860736 00000100:00100000:0.0:1789479971.531168:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860736 00000100:00100000:0.0:1789479971.531182:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861248 00000100:00100000:0.0:1789479971.531184:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861248 00000100:00100000:0.0:1789479971.531231:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789479971.531237:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527860608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531274:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527860608:12345-0@lo:400:kworker.0 Request processed in 37us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531280:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789479971.531292:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789479971.531298:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527861120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531345:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527861120:12345-0@lo:400:kworker.0 Request processed in 47us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531351:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789479971.531363:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789479971.531368:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527860736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531396:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527860736:12345-0@lo:400:kworker.0 Request processed in 28us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531402:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789479971.531414:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789479971.531420:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527861248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531448:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527861248:12345-0@lo:400:kworker.0 Request processed in 28us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479971.531453:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789479971.531485:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479971.531490:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789479971.531535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527859968:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531567:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527859712:0@lo:400:kworker.0 00000100:00100000:0.0:1789479971.531578:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527860224:0@lo:400:kworker.0 00010000:00080000:0.0:1789479971.531591:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dca80 x1876405527860736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479971.531602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527860736:0@lo:400:kworker.0 00010000:00080000:0.0:1789479971.531612:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dd500 x1876405527861248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479971.531621:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527861248:0@lo:400:kworker.0 00010000:00080000:0.0:1789479971.531632:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb507480 x1876405527860608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479971.531641:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527860608:0@lo:400:kworker.0 00010000:00080000:0.0:1789479971.531651:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5df100 x1876405527861120/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479971.531659:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527861120:0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.532853:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860096 00000100:00100000:2.0:1789479971.532872:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860096 00000100:00100000:2.0:1789479971.532926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527859840 00000100:00100000:2.0:1789479971.532929:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527859840 00000100:00100000:2.0:1789479971.532941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860352 00000100:00100000:2.0:1789479971.532943:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860352 00000100:00100000:2.0:1789479971.532972:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860864 00000100:00100000:2.0:1789479971.532976:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860864 00000100:00100000:2.0:1789479971.532990:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860480 00000100:00100000:2.0:1789479971.532993:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860480 00000100:00100000:2.0:1789479971.533006:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527860992 00000100:00100000:2.0:1789479971.533009:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527860992 00000100:00100000:2.0:1789479971.533029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789479971.533038:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527860096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533136:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527860096:12345-0@lo:400:kworker.0 Request processed in 100us (3225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533145:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789479971.533176:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789479971.533183:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527859840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533244:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527859840:12345-0@lo:400:kworker.0 Request processed in 62us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789479971.533263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789479971.533269:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527860352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533297:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527860352:12345-0@lo:400:kworker.0 Request processed in 29us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533320:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789479971.533332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789479971.533338:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527860864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533369:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527860864:12345-0@lo:400:kworker.0 Request processed in 32us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789479971.533386:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789479971.533392:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527860480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533420:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527860480:12345-0@lo:400:kworker.0 Request processed in 29us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533425:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789479971.533436:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789479971.533443:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527860992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533469:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527860992:12345-0@lo:400:kworker.0 Request processed in 28us (2892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479971.533475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1789479971.533566:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d31f80 x1876405527860480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479971.533584:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527860480:0@lo:400:kworker.0 00010000:00080000:2.0:1789479971.533597:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dd180 x1876405527860992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479971.533604:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527860992:0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533616:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527859840:0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533638:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527860352:0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533649:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527860864:0@lo:400:kworker.0 00000100:00100000:2.0:1789479971.533692:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527860096:0@lo:400:kworker.0 00000100:00080000:0.0:1789479971.537292:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479971.537307:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789479971.541586:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789479971.541619:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527861376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479971.541720:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479971.542172:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861376 00000100:00100000:3.0:1789479971.542183:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861376 00000100:00100000:3.0:1789479971.542296:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789479971.542308:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527861376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479971.542383:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479971.542457:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527861376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479971.542466:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789479971.542791:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527861376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479972.037380:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527861504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479972.037471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479972.037582:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861504 00000100:00100000:0.0:1789479972.037592:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861504 00000100:00100000:0.0:1789479972.037669:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479972.037680:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527861504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789479972.037717:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479972.037779:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527861504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479972.037787:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789479972.037839:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987f64000 x1876405527861504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479972.037859:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527861504:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789479972.047906:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789479972.047949:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527861632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479972.048057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479972.048143:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861632 00000100:00100000:2.0:1789479972.048152:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861632 00000100:00100000:2.0:1789479972.048236:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789479972.048246:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527861632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479972.055000:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479972.055167:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527861632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6915us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479972.055180:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789479972.055542:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6d80 x1876405527861632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479972.055575:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527861632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789479972.164726:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479973.190570:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479973.209561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479973.209616:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479973.209647:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479973.209677:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861120 00000100:00100000:2.0:1789479973.209687:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861120 00000100:00100000:2.0:1789479973.209750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861248 00000100:00100000:2.0:1789479973.209754:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861248 00000100:00100000:2.0:1789479973.209776:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:2.0:1789479973.209785:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507861120:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479973.209865:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507861120:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 81us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479973.209885:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:2.0:1789479973.209902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1789479973.209909:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507861248:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479973.209934:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507861248:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479973.209939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1789479973.209959:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507860992 00000100:00100000:2.0:1789479973.209962:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507860992 00000100:00100000:2.0:1789479973.209981:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00100000:2.0:1789479973.209988:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507860992:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479973.210012:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507860992:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479973.210018:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 291 00000100:00080000:0.0:1789479973.214116:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479973.214126:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479974.087400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479974.087481:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479974.087687:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861760 00000100:00100000:0.0:1789479974.087695:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861760 00000100:00100000:0.0:1789479974.087768:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789479974.087778:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527861760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479974.087811:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479974.087858:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527861760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479974.087864:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789479974.087971:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789479974.088008:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987f64000 x1876405527861760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479974.088028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527861760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479974.088642:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527861888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479974.088684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479974.089335:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527861888 00000100:00100000:2.0:1789479974.089343:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527861888 00000100:00100000:2.0:1789479974.089395:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789479974.089404:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527861888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789479974.089423:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479974.089476:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527861888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479974.089482:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789479974.089515:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce4a80 x1876405527861888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789479974.089636:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479974.089690:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527861888:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789479974.217450:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479974.602894:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527862016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789479974.602955:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479974.603017:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862016 00000100:00100000:0.0:1789479974.603024:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862016 00000100:00100000:0.0:1789479974.603063:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789479974.603071:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527862016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789479974.603100:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479974.603140:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527862016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479974.603147:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789479974.603185:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527862016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789479975.241048:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479976.260408:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479976.644326:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479976.644350:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527862144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479976.644420:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.644500:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862144 00000100:00100000:3.0:1789479976.644508:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862144 00000100:00100000:3.0:1789479976.644567:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789479976.644576:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527862144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479976.644610:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479976.644655:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527862144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.644662:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789479976.644709:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527862144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479976.649795:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789479976.649873:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479976.649896:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527862656:0@lo:400:kworker.0 00000100:00100000:1.0:1789479976.649962:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.650124:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527862400:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.650152:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.650173:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479976.650178:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527862528:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.653662:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.653743:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862528 00000100:00100000:3.0:1789479976.653752:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862528 00000100:00100000:3.0:1789479976.653805:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789479976.653814:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a87833050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527862528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.653879:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a87833050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527862528:12345-0@lo:400:kworker.0 Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.653886:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789479976.654141:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527862528:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.654394:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862656 00000100:00100000:3.0:1789479976.654399:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862656 00000100:00100000:3.0:1789479976.654428:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862400 00000100:00100000:3.0:1789479976.654431:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862400 00000100:00100000:3.0:1789479976.654451:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789479976.654458:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527862656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.654516:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527862656:12345-0@lo:400:kworker.0 Request processed in 58us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.654523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789479976.654535:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789479976.654554:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527862400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.654586:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527862400:12345-0@lo:400:kworker.0 Request processed in 45us (4433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.654592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789479976.654629:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527862656:0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.654653:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527862400:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.655055:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527862272:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.655107:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479976.655350:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862272 00000100:00100000:3.0:1789479976.655356:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862272 00000100:00100000:3.0:1789479976.655385:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789479976.655392:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527862272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479976.655429:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527862272:12345-0@lo:400:kworker.0 Request processed in 38us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479976.655446:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789479976.655812:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527862272:0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.658408:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527863040:0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.658474:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479976.658524:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527863552:0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.658546:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479976.658786:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789479976.658793:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527862912:0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.658821:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479976.658840:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527863424:0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.658859:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479976.658891:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863040 00000100:00100000:0.0:1789479976.658899:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863040 00000100:00100000:0.0:1789479976.658955:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863552 00000100:00100000:0.0:1789479976.658959:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863552 00000100:00100000:0.0:1789479976.658991:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479976.659000:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527863040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.659051:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527863040:12345-0@lo:400:kworker.0 Request processed in 52us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479976.659057:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789479976.659073:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789479976.659080:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527863552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479976.659106:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527863552:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479976.659111:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789479976.659126:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789479976.659130:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789479976.659153:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dd500 x1876405527863040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479976.659167:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527863040:0@lo:400:kworker.0 00010000:00080000:0.0:1789479976.659177:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dea00 x1876405527863552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479976.659327:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527862784:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659358:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.659380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527863296:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659404:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.659421:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789479976.659427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527863168:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.659463:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527863680:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479976.659521:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862912 00000100:00100000:2.0:1789479976.659525:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862912 00000100:00100000:2.0:1789479976.659550:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863424 00000100:00100000:2.0:1789479976.659553:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863424 00000100:00100000:2.0:1789479976.659564:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527862784 00000100:00100000:2.0:1789479976.659567:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527862784 00000100:00100000:2.0:1789479976.659578:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863296 00000100:00100000:2.0:1789479976.659580:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863296 00000100:00100000:2.0:1789479976.659594:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789479976.659600:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527862912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659634:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527862912:12345-0@lo:400:kworker.0 Request processed in 34us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.659641:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789479976.659662:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789479976.659668:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527863424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659846:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527863424:12345-0@lo:400:kworker.0 Request processed in 177us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.659852:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789479976.659865:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789479976.659870:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527862784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659907:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527862784:12345-0@lo:400:kworker.0 Request processed in 36us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.659912:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789479976.659923:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789479976.659929:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527863296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.659956:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527863296:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.659961:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789479976.659978:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863168 00000100:00100000:2.0:1789479976.659982:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863168 00000100:00100000:2.0:1789479976.660001:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863680 00000100:00100000:2.0:1789479976.660004:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863680 00000100:00100000:2.0:1789479976.660018:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789479976.660024:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527863168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.660049:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527863168:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.660054:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789479976.660063:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789479976.660069:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527863680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.660103:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527863680:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479976.660108:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789479976.660123:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479976.660126:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789479976.660129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479976.660131:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789479976.660157:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dca80 x1876405527863168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479976.660167:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527863168:0@lo:400:kworker.0 00010000:00080000:2.0:1789479976.660176:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d30a80 x1876405527863680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479976.660951:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527863552:0@lo:400:kworker.0 00010000:00080000:0.0:1789479976.661004:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5df100 x1876405527862912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479976.661015:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527862912:0@lo:400:kworker.0 00010000:00080000:0.0:1789479976.661027:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5df800 x1876405527863424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479976.661034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527863424:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.661131:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527863680:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.661151:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527862784:0@lo:400:kworker.0 00000100:00100000:2.0:1789479976.661160:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527863296:0@lo:400:kworker.0 00000100:00100000:0.0:1789479977.160292:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789479977.160314:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527863808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479977.160389:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479977.160462:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863808 00000100:00100000:0.0:1789479977.160468:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863808 00000100:00100000:0.0:1789479977.160522:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789479977.160530:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527863808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789479977.160558:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479977.160600:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527863808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479977.160607:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789479977.160642:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6a00 x1876405527863808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479977.160657:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527863808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479977.160985:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527863936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789479977.161018:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479977.161135:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527863936 00000100:00100000:1.0:1789479977.161141:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527863936 00000100:00100000:1.0:1789479977.161175:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789479977.161182:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527863936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789479977.161219:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479977.161258:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527863936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479977.161263:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1789479977.161333:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce4000 x1876405527863936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479977.161346:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527863936:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479977.284471:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789479978.309516:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479978.323905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479978.323970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479978.324044:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479978.324080:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861504 00000100:00100000:0.0:1789479978.324094:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861504 00000100:00100000:0.0:1789479978.324168:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861632 00000100:00100000:0.0:1789479978.324172:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861632 00000100:00100000:0.0:1789479978.324227:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1789479978.324240:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507861504:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479978.324342:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507861504:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 105us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479978.324368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1789479978.324389:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:0.0:1789479978.324396:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507861632:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479978.324424:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507861632:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479978.324430:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00080000:0.0:1789479978.324448:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789479978.324453:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479978.326873:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861376 00000100:00100000:3.0:1789479978.326900:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861376 00000100:00100000:3.0:1789479978.327041:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:3.0:1789479978.327054:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507861376:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479978.327166:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507861376:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 115us (3194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479978.327174:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:2.0:1789479979.204896:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527864064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789479979.204966:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479979.205393:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864064 00000100:00100000:1.0:1789479979.205402:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864064 00000100:00100000:1.0:1789479979.205486:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789479979.205497:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527864064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789479979.205531:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479979.205584:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527864064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479979.205608:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789479979.205732:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479979.205769:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce5c00 x1876405527864064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479979.205789:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527864064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789479979.215595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789479979.215624:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527864192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479979.215692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479979.216088:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864192 00000100:00100000:1.0:1789479979.216096:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864192 00000100:00100000:1.0:1789479979.216162:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789479979.216171:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527864192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789479979.216228:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479979.216276:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527864192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479979.216283:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789479979.216497:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789479979.216535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce7100 x1876405527864192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479979.216557:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527864192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789479979.334154:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479979.718830:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479979.718857:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527864320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789479979.718972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479979.719094:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864320 00000100:00100000:3.0:1789479979.719102:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864320 00000100:00100000:3.0:1789479979.719151:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789479979.719160:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527864320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479979.719236:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479979.719280:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527864320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479979.719287:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789479979.719702:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527864320:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789479980.356606:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479981.380646:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789479981.764747:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789479981.764767:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527864448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479981.764825:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.764855:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864448 00000100:00100000:3.0:1789479981.764863:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864448 00000100:00100000:3.0:1789479981.764915:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789479981.764924:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527864448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789479981.764953:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789479981.764990:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527864448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.764996:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789479981.765161:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527864448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479981.768123:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527864704:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768241:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527864576:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768241:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527865216:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768264:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768273:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479981.768277:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527865728:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479981.768320:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789479981.768325:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527864832:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768347:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479981.768364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527865344:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768383:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479981.768399:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527865856:0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768418:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768430:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527865088:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.768455:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768473:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527865600:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.768491:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768502:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789479981.768507:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527864960:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.768525:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768536:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527865472:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.768553:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768568:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527865984:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.768585:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479981.768613:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864576 00000100:00100000:3.0:1789479981.768619:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864576 00000100:00100000:3.0:1789479981.768655:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789479981.768662:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527864576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.768782:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864704 00000100:00100000:2.0:1789479981.768787:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864704 00000100:00100000:2.0:1789479981.768810:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865216 00000100:00100000:2.0:1789479981.768812:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865216 00000100:00100000:3.0:1789479981.768897:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527864576:12345-0@lo:400:kworker.0 Request processed in 234us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.768913:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789479981.768999:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865728 00000100:00100000:0.0:1789479981.769003:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865728 00000100:00100000:2.0:1789479981.769427:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865088 00000100:00100000:2.0:1789479981.769433:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865088 00000100:00100000:3.0:1789479981.770617:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865600 00000100:00100000:3.0:1789479981.770627:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865600 00000100:00100000:3.0:1789479981.770732:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864960 00000100:00100000:3.0:1789479981.770736:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864960 00000100:00100000:3.0:1789479981.770752:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789479981.770761:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527864704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.770843:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527864704:12345-0@lo:400:kworker.0 Request processed in 83us (2655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.770850:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789479981.770865:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789479981.770872:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527865216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.770897:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527865216:12345-0@lo:400:kworker.0 Request processed in 26us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.770902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789479981.770912:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789479981.770916:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527865600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.770938:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527865600:12345-0@lo:400:kworker.0 Request processed in 22us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.770943:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789479981.770953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789479981.770958:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527864960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.770978:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527864960:12345-0@lo:400:kworker.0 Request processed in 21us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.770983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789479981.771009:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865344 00000100:00100000:3.0:1789479981.771014:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865344 00000100:00100000:3.0:1789479981.771031:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865856 00000100:00100000:3.0:1789479981.771034:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865856 00000100:00100000:3.0:1789479981.771044:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865472 00000100:00100000:3.0:1789479981.771047:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865472 00000100:00100000:3.0:1789479981.771057:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527865984 00000100:00100000:3.0:1789479981.771059:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527865984 00000100:00100000:3.0:1789479981.771076:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789479981.771081:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527865344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771109:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527865344:12345-0@lo:400:kworker.0 Request processed in 28us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.771114:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789479981.771124:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789479981.771129:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527865856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771149:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527865856:12345-0@lo:400:kworker.0 Request processed in 21us (2731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.771153:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789479981.771161:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789479981.771166:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527865472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771185:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527865472:12345-0@lo:400:kworker.0 Request processed in 20us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.771210:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789479981.771221:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789479981.771226:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527865984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771251:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527865984:12345-0@lo:400:kworker.0 Request processed in 25us (2664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.771265:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789479981.771287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789479981.771291:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479981.771293:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789479981.771295:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789479981.771327:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f5880 x1876405527865344/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479981.771342:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527865344:0@lo:400:kworker.0 00010000:00080000:3.0:1789479981.771354:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1ea00 x1876405527865856/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479981.771362:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527865856:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527864704:0@lo:400:kworker.0 00010000:00080000:3.0:1789479981.771380:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f6300 x1876405527865216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479981.771386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527865216:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771419:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527864960:0@lo:400:kworker.0 00010000:00080000:3.0:1789479981.771428:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f4a80 x1876405527865472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479981.771436:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527865472:0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.771634:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00010000:00080000:3.0:1789479981.771637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1d500 x1876405527865984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479981.771641:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527865728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771646:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527865984:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771666:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527864576:0@lo:400:kworker.0 00000100:00100000:3.0:1789479981.771677:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527865600:0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.771680:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527865728:12345-0@lo:400:kworker.0 Request processed in 41us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479981.771686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789479981.771710:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789479981.771717:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527865088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.771748:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527865088:12345-0@lo:400:kworker.0 Request processed in 32us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479981.771754:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527865088:0@lo:400:kworker.0 00000100:00100000:0.0:1789479981.771754:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789479981.771801:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527864832 00000100:00100000:2.0:1789479981.771807:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527864832 00000100:00100000:2.0:1789479981.771873:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789479981.771880:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527864832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479981.771916:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527864832:12345-0@lo:400:kworker.0 Request processed in 38us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479981.771922:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789479981.772059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527864832:0@lo:400:kworker.0 00010000:00080000:0.0:1789479981.772069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e680 x1876405527865728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789479997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479981.772087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527865728:0@lo:400:kworker.0 00000100:00100000:0.0:1789479982.279857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527866112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479982.279940:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479982.283842:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866112 00000100:00100000:3.0:1789479982.283860:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866112 00000100:00100000:3.0:1789479982.283930:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789479982.283942:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abbbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527866112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789479982.283980:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479982.284077:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abbbfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527866112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (4126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479982.284084:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1789479982.284302:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce5500 x1876405527866112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479982.284323:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527866112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479982.285627:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527866240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789479982.285681:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479982.292796:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866240 00000100:00100000:0.0:1789479982.292811:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866240 00000100:00100000:0.0:1789479982.292873:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789479982.292883:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527866240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789479982.292909:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479982.293008:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527866240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (7326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479982.293015:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789479982.304251:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862fa300 x1876405527866240/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789479998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479982.304278:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527866240:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479982.406939:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479983.429648:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479983.445469:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479983.445513:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479983.445543:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861888 00000100:00100000:1.0:1789479983.445552:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861888 00000100:00100000:1.0:1789479983.445617:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:1.0:1789479983.445628:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507861888:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479983.445717:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507861888:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479983.445725:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00080000:1.0:1789479983.445746:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479983.446087:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507861760 00000100:00100000:3.0:1789479983.446093:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507861760 00000100:00100000:3.0:1789479983.446136:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:3.0:1789479983.446145:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507861760:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479983.446213:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507861760:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 46us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479983.446221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:1.0:1789479983.471166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479983.472215:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862016 00000100:00100000:0.0:1789479983.472228:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862016 00000100:00100000:0.0:1789479983.472296:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:0.0:1789479983.472306:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507862016:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479983.472381:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507862016:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 77us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479983.472389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00080000:1.0:1789479983.474988:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789479984.329015:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527866368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789479984.329078:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479984.329285:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527866496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789479984.329314:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479984.329351:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866368 00000100:00100000:2.0:1789479984.329359:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866368 00000100:00100000:2.0:1789479984.329407:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866496 00000100:00100000:2.0:1789479984.329411:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866496 00000100:00100000:2.0:1789479984.329428:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479984.329437:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527866368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479984.331940:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479984.332042:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527866368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2602us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479984.332051:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479984.332082:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789479984.332093:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527866496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789479984.332119:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479984.335852:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527866496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3189us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479984.335866:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789479984.335901:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479984.335941:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e0700 x1876405527866368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479984.335963:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527866368:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789479984.335994:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e1880 x1876405527866496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479984.336006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527866496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789479984.454792:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479984.836533:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479984.836560:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527866624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789479984.836635:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479984.836920:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866624 00000100:00100000:3.0:1789479984.836928:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866624 00000100:00100000:3.0:1789479984.836986:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789479984.836997:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527866624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479984.837030:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479984.837094:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527866624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479984.837101:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789479984.837212:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527866624:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789479985.479403:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479986.503775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479986.884626:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479986.884648:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527866752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789479986.884714:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885043:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527866880:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885131:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527867392:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885165:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885183:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527867904:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885243:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789479986.885248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527867264:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885266:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885281:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527867776:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527868288:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479986.885356:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867392 00000100:00100000:1.0:1789479986.885363:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867392 00000100:00100000:1.0:1789479986.885406:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867904 00000100:00100000:1.0:1789479986.885410:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867904 00000100:00100000:1.0:1789479986.885422:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867264 00000100:00100000:1.0:1789479986.885435:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867264 00000100:00100000:1.0:1789479986.885452:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789479986.885460:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527867392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885520:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527867392:12345-0@lo:400:kworker.0 Request processed in 60us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.885527:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789479986.885542:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789479986.885548:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527867904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885574:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527867904:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.885585:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789479986.885597:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789479986.885602:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527867264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885627:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527867264:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.885632:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789479986.885688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527867264:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885700:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527867392:0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.885707:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527867904:0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.885992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866880 00000100:00100000:3.0:1789479986.885997:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866880 00000100:00100000:3.0:1789479986.886037:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789479986.886045:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527866880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.886095:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527866880:12345-0@lo:400:kworker.0 Request processed in 51us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.886101:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1789479986.886128:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867776 00000100:00100000:3.0:1789479986.886132:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867776 00000100:00100000:3.0:1789479986.886153:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868288 00000100:00100000:3.0:1789479986.886156:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868288 00000100:00100000:3.0:1789479986.886173:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789479986.886180:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527867776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.886244:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527867776:12345-0@lo:400:kworker.0 Request processed in 65us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.886249:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789479986.886268:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789479986.886273:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527868288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.886301:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527868288:12345-0@lo:400:kworker.0 Request processed in 28us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479986.886306:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789479986.886336:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dd180 x1876405527867776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479986.886345:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527867776:0@lo:400:kworker.0 00010000:00080000:3.0:1789479986.886354:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9f80 x1876405527868288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479986.886361:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527868288:0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.886368:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527866880:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886634:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527866752 00000100:00100000:2.0:1789479986.886639:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527866752 00000100:00100000:2.0:1789479986.886685:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789479986.886693:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527866752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789479986.886719:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479986.886769:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527866752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479986.886775:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789479986.886796:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527867008:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886824:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479986.886843:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527867520:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886861:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479986.886885:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527868032:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886904:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479986.886921:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789479986.886926:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527867136:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886947:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479986.886961:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527867648:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.886983:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479986.886998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527868160:0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.887018:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789479986.887040:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479986.887045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789479986.887061:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479986.887073:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867648 00000100:00100000:2.0:1789479986.887077:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867648 00000100:00100000:2.0:1789479986.887098:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868160 00000100:00100000:2.0:1789479986.887101:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868160 00000100:00100000:2.0:1789479986.887115:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479986.887120:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527867648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.887154:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527867648:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479986.887160:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789479986.887171:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789479986.887177:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527868160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479986.887223:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527868160:12345-0@lo:400:kworker.0 Request processed in 46us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479986.887228:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789479986.887245:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479986.887253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789479986.887273:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dd500 x1876405527867648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479986.887284:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527867648:0@lo:400:kworker.0 00010000:00080000:2.0:1789479986.887294:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9180 x1876405527868160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479986.887303:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527868160:0@lo:400:kworker.0 00000100:00100000:0.0:1789479986.887865:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867136 00000100:00100000:0.0:1789479986.887871:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867136 00000100:00100000:0.0:1789479986.887901:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789479986.887909:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527867136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479986.887955:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527867136:12345-0@lo:400:kworker.0 Request processed in 47us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479986.887961:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789479986.887991:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527867136:0@lo:400:kworker.0 00000100:00100000:3.0:1789479986.888102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527866752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789479986.888352:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867008 00000100:00100000:1.0:1789479986.888357:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867008 00000100:00100000:1.0:1789479986.888392:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527867520 00000100:00100000:1.0:1789479986.888395:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527867520 00000100:00100000:1.0:1789479986.888422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868032 00000100:00100000:1.0:1789479986.888425:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868032 00000100:00100000:1.0:1789479986.888451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789479986.888459:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527867008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.888498:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527867008:12345-0@lo:400:kworker.0 Request processed in 40us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.888505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789479986.888643:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789479986.888650:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527867520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.888690:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527867520:12345-0@lo:400:kworker.0 Request processed in 41us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.888696:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789479986.888720:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789479986.888726:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789479986.888767:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527868032:12345-0@lo:400:kworker.0 Request processed in 41us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479986.888773:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789479986.888913:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527867008:0@lo:400:kworker.0 00010000:00080000:0.0:1789479986.888926:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4ddc00 x1876405527867520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479986.888936:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527867520:0@lo:400:kworker.0 00010000:00080000:0.0:1789479986.888947:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df480 x1876405527868032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479986.888956:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527868032:0@lo:400:kworker.0 00000100:00080000:3.0:1789479986.889016:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789479987.397652:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479987.397683:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527868416:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789479987.397766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479987.397968:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868416 00000100:00100000:3.0:1789479987.397976:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868416 00000100:00100000:3.0:1789479987.398038:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789479987.398046:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527868416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789479987.398073:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479987.398126:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527868416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479987.398133:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789479987.398282:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9f80 x1876405527868416/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479987.398301:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527868416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789479987.398482:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527868544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789479987.398512:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479987.398624:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868544 00000100:00100000:3.0:1789479987.398629:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868544 00000100:00100000:3.0:1789479987.398660:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789479987.398690:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527868544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789479987.398704:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789479987.398751:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527868544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479987.398757:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789479987.398881:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6a00 x1876405527868544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479987.398908:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527868544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789479987.526422:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479988.549299:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479988.572022:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479988.572077:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479988.572109:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479988.572136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862400 00000100:00100000:0.0:1789479988.572144:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862400 00000100:00100000:0.0:1789479988.572223:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862272 00000100:00100000:0.0:1789479988.572227:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862272 00000100:00100000:0.0:1789479988.572251:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:0.0:1789479988.572260:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507862400:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479988.572323:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507862400:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479988.572330:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:0.0:1789479988.572347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00100000:0.0:1789479988.572353:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507862272:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479988.572375:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507862272:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479988.572381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00080000:0.0:1789479988.572398:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789479988.572402:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789479988.573459:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862144 00000100:00100000:3.0:1789479988.573470:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862144 00000100:00100000:3.0:1789479988.573520:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 297 00000100:00100000:3.0:1789479988.573541:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507862144:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479988.573599:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2400:x1876405507862144:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 71us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479988.573606:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 297 00000001:02000400:2.0:1789479988.582069:0:12001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:46:26 (1789479986) === 00000100:00100000:0.0:1789479989.445309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479989.445332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527868672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479989.445405:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479989.445604:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868672 00000100:00100000:2.0:1789479989.445612:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868672 00000100:00100000:1.0:1789479989.445783:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479989.445828:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479989.447402:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868800 00000100:00100000:2.0:1789479989.447412:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868800 00000100:00100000:1.0:1789479989.447491:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789479989.447504:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527868672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789479989.447535:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479989.447606:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527868672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (2200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.447612:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1789479989.447679:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669ed80 x1876405527868672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479989.447699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527868672:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789479989.454678:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479989.463304:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789479989.463319:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527868800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479989.463345:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479989.463544:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (17715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479989.463552:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789479989.474930:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6680 x1876405527868800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479989.474959:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527868800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789479989.572455:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479989.759922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.760015:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862528 00000100:00100000:1.0:1789479989.760025:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862528 00000100:00100000:1.0:1789479989.760080:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 298 00000100:00100000:1.0:1789479989.760089:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:8748:x1876405507862528:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789479989.760105:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479989.760123:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bc400/0xdaa289fda243d322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d29ea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.760151:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bc400/0xdaa289fda243d322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ea expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.760177:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bc400/0xdaa289fda243d322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ea expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.760186:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc400, rc 0) 00000100:00100000:1.0:1789479989.760275:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507862528:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 186us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.760282:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 298 00000100:00100000:3.0:1789479989.786240:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.786367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862656 00000100:00100000:1.0:1789479989.786388:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862656 00000100:00100000:1.0:1789479989.786443:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 299 00000100:00100000:1.0:1789479989.786453:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507862656:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789479989.786813:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507862656:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 361us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.786821:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 299 00000100:00100000:0.0:1789479989.792603:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479989.792907:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862784 00000100:00100000:3.0:1789479989.792920:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862784 00000100:00100000:3.0:1789479989.792989:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 300 00000100:00100000:3.0:1789479989.793001:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507862784:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789479989.793568:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507862784:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 567us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479989.793578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 300 00000100:00100000:3.0:1789479989.813212:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.815987:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507862912 00000100:00100000:1.0:1789479989.816009:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507862912 00000100:00100000:1.0:1789479989.816122:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:1.0:1789479989.816135:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507862912:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479989.816421:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507862912:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 280us (3237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.816430:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 301 00000100:00100000:2.0:1789479989.896155:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.896410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863040 00000100:00100000:1.0:1789479989.896425:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863040 00000100:00100000:1.0:1789479989.896489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 302 00000100:00100000:1.0:1789479989.896499:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507863040:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479989.896686:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507863040:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 187us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.896695:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 302 00000100:00100000:0.0:1789479989.911467:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479989.915141:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863168 00000100:00100000:3.0:1789479989.915163:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863168 00000100:00100000:3.0:1789479989.915310:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:3.0:1789479989.915322:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507863168:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789479989.915557:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8752:x1876405507863168:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 236us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479989.915565:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:0.0:1789479989.933606:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479989.933698:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863296 00000100:00100000:3.0:1789479989.933716:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863296 00000100:00100000:3.0:1789479989.933796:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 304 00000100:00100000:3.0:1789479989.933809:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:8748:x1876405507863296:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789479989.933831:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789479989.933856:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a1b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479989.933893:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a1b expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479989.933906:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a1b expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789479989.933926:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7600, rc 0) 00000100:00100000:3.0:1789479989.934008:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:8748:x1876405507863296:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 202us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479989.934015:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 304 00000100:00100000:3.0:1789479989.937515:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.937697:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863424 00000100:00100000:1.0:1789479989.937711:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863424 00000100:00100000:1.0:1789479989.937784:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 305 00000100:00100000:1.0:1789479989.937796:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:8748:x1876405507863424:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789479989.937832:0:6514:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789479989.937869:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789479989.937873:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789479989.937876:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789479989.937880:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789479989.937883:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789479989.953884:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:8748:x1876405507863424:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 16078us (16370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.953901:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 305 00000100:00100000:2.0:1789479989.956873:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479989.956907:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527868928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789479989.957007:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479989.957217:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527868928 00000100:00100000:3.0:1789479989.957227:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527868928 00000100:00100000:3.0:1789479989.957288:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789479989.957299:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527868928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479989.957339:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479989.957433:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527868928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479989.957440:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789479989.958006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527868928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789479989.962327:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.963725:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863552 00000100:00100000:1.0:1789479989.963748:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863552 00000100:00100000:1.0:1789479989.963805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 306 00000100:00100000:1.0:1789479989.963814:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:8748:x1876405507863552:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789479989.963830:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789479989.963850:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a22 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.963879:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.963906:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789479989.963916:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd800, rc 0) 00000100:00100000:1.0:1789479989.963977:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8748:x1876405507863552:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 164us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.963984:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 306 00000100:00100000:2.0:1789479989.981637:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479989.981794:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863680 00000100:00100000:1.0:1789479989.981809:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863680 00000100:00100000:1.0:1789479989.981937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 307 00000100:00100000:1.0:1789479989.981952:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8748:x1876405507863680:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789479989.982265:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8748:x1876405507863680:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 316us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479989.982274:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 307 00000100:00100000:0.0:1789479990.000156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479990.000297:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863808 00000100:00100000:3.0:1789479990.000311:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863808 00000100:00100000:3.0:1789479990.000372:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 308 00000100:00100000:3.0:1789479990.000384:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8748:x1876405507863808:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789479990.000586:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8748:x1876405507863808:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 203us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479990.000595:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 308 00000100:00100000:2.0:1789479990.004746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479990.005081:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507863936 00000100:00100000:1.0:1789479990.005094:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507863936 00000100:00100000:1.0:1789479990.005165:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 309 00000100:00100000:1.0:1789479990.005177:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8757:x1876405507863936:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479990.005553:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8757:x1876405507863936:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 376us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479990.005563:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 309 00000100:00100000:2.0:1789479990.018179:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479990.018388:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864064 00000100:00100000:1.0:1789479990.018400:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864064 00000100:00100000:1.0:1789479990.018470:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 310 00000100:00100000:1.0:1789479990.018482:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8757:x1876405507864064:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789479990.018685:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:8757:x1876405507864064:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 205us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479990.018693:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 310 00000100:00100000:0.0:1789479990.044325:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479990.044359:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479990.044393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479990.044434:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479990.044474:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864192 00000100:00100000:0.0:1789479990.044486:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864192 00000100:00100000:0.0:1789479990.044521:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864704 00000100:00100000:0.0:1789479990.044523:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864704 00000100:00100000:0.0:1789479990.044530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864320 00000100:00100000:0.0:1789479990.044532:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864320 00000100:00100000:0.0:1789479990.044570:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864448 00000100:00100000:0.0:1789479990.044572:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864448 00000100:00100000:0.0:1789479990.044591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:0.0:1789479990.044602:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507864320:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479990.044709:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507864320:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.044716:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:0.0:1789479990.044751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:0.0:1789479990.044757:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507864448:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479990.044781:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507864448:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.044787:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:0.0:1789479990.044798:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1789479990.044803:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876405507864192:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789479990.044831:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 71ef009f-7b67-4186-8594-2437af8601ad@192.168.206.44@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:0.0:1789479990.044875:0:6521:0:(genops.c:1384:class_connect()) connect: client 71ef009f-7b67-4186-8594-2437af8601ad, cookie 0xdaa289fda243d337 00000004:00100000:0.0:1789479990.044908:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789479990.045056:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8a6987e55800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479990.045091:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:2398:x1876405507864192:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 287us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.045099:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1789479990.045113:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789479990.045118:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876405507864704:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789479990.045133:0:6521:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 71ef009f-7b67-4186-8594-2437af8601ad@192.168.206.44@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:0.0:1789479990.045156:0:6521:0:(genops.c:1384:class_connect()) connect: client 71ef009f-7b67-4186-8594-2437af8601ad, cookie 0xdaa289fda243d33e 00000004:00100000:0.0:1789479990.045168:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789479990.045273:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8a6987e50000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789479990.045297:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:2398:x1876405507864704:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 178us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.045304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00080000:1.0:1789479990.046084:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789479990.046092:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789479990.072922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479990.072968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479990.073272:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864960 00000100:00100000:0.0:1789479990.073301:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864960 00000100:00100000:0.0:1789479990.073395:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864832 00000100:00100000:0.0:1789479990.073399:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864832 00000100:00100000:0.0:1789479990.073441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789479990.073453:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507864960:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789479990.073494:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789479990.073610:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507864960:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 159us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.073618:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789479990.073639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:0.0:1789479990.073646:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:0:x1876405507864832:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789479990.073690:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789479990.073730:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:0:x1876405507864832:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 84us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479990.073736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1789479990.073933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479990.074102:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507864576 00000100:00100000:1.0:1789479990.074108:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507864576 00000100:00100000:1.0:1789479990.074149:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1789479990.074158:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:0:x1876405507864576:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789479990.074172:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789479990.074227:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:0:x1876405507864576:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479990.074234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00080000:1.0:1789479990.074253:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789479990.074258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789479990.102943:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479990.110359:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865088 00000100:00100000:2.0:1789479990.110379:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865088 00000100:00100000:2.0:1789479990.110491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1789479990.110504:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865088:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789479990.110627:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865088:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 126us (7701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479990.110635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1789479990.117892:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479990.117942:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789479990.118531:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865472 00000100:00100000:2.0:1789479990.118544:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865472 00000100:00100000:2.0:1789479990.118615:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1789479990.118627:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865472:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789479990.118738:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865472:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 113us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479990.118746:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:3.0:1789479990.119347:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865216 00000100:00100000:3.0:1789479990.119355:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865216 00000100:00100000:3.0:1789479990.119395:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1789479990.119402:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876405507865216:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789479990.119445:0:8493:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 71ef009f-7b67-4186-8594-2437af8601ad@192.168.206.44@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:3.0:1789479990.119481:0:8493:0:(genops.c:1384:class_connect()) connect: client 71ef009f-7b67-4186-8594-2437af8601ad, cookie 0xdaa289fda243d345 00002000:00100000:3.0:1789479990.119495:0:8493:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 71ef009f-7b67-4186-8594-2437af8601ad/ffff8a6986b0d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789479990.119508:0:8493:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789479990.119597:0:8493:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789479990.119628:0:8493:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479990.119698:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2398:x1876405507865216:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 295us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479990.119706:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1789479990.120228:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789479990.120395:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865344 00000100:00100000:3.0:1789479990.120402:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865344 00000100:00100000:3.0:1789479990.120446:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1789479990.120474:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1876405507865344:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789479990.120502:0:8435:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 71ef009f-7b67-4186-8594-2437af8601ad@192.168.206.44@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:3.0:1789479990.120528:0:8435:0:(genops.c:1384:class_connect()) connect: client 71ef009f-7b67-4186-8594-2437af8601ad, cookie 0xdaa289fda243d34c 00002000:00100000:3.0:1789479990.120537:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 71ef009f-7b67-4186-8594-2437af8601ad/ffff8a6986b0d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789479990.120553:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789479990.120608:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789479990.120630:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789479990.120696:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:71ef009f-7b67-4186-8594-2437af8601ad+6:2398:x1876405507865344:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 221us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479990.120704:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1789479990.131805:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479990.135485:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865600 00000100:00100000:1.0:1789479990.135513:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865600 00000100:00100000:1.0:1789479990.135604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:1.0:1789479990.135617:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865600:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789479990.135762:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789479990.135889:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:8748:x1876405507865600:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 274us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479990.135918:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00010000:00010000:0.0:1789479990.596438:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479991.620928:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479992.005505:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527869184:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.005615:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.005698:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527869696:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.005721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.005744:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527870208:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.005765:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.005816:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789479992.005822:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527869056:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.005867:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.005892:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527869568:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006055:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006077:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527870080:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006102:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006120:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527870592:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006395:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006563:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527869440:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006595:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527869952:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006655:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006675:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527870464:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006695:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006717:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789479992.006724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527869312:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006763:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527869824:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006793:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527870336:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.006811:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.006838:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869184 00000100:00100000:2.0:1789479992.007132:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870080 00000100:00100000:2.0:1789479992.007138:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870080 00000100:00100000:2.0:1789479992.007494:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870592 00000100:00100000:2.0:1789479992.007499:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870592 00000100:00100000:2.0:1789479992.007517:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869952 00000100:00100000:2.0:1789479992.007520:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869952 00000100:00100000:2.0:1789479992.007532:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870464 00000100:00100000:2.0:1789479992.007535:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870464 00000100:00100000:2.0:1789479992.007551:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789479992.007575:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527870080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.007667:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527870080:12345-0@lo:400:kworker.0 Request processed in 94us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.007675:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789479992.007696:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479992.007702:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527870592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.007828:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479992.007851:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527870720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479992.008003:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479992.008744:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869184 00000100:00100000:3.0:1789479992.008798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869696 00000100:00100000:3.0:1789479992.008804:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869696 00000100:00100000:3.0:1789479992.008824:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870208 00000100:00100000:3.0:1789479992.008827:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870208 00000100:00100000:3.0:1789479992.008843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869440 00000100:00100000:3.0:1789479992.008846:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869440 00000100:00100000:2.0:1789479992.009850:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527870592:12345-0@lo:400:kworker.0 Request processed in 2139us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.009865:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789479992.009898:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789479992.009910:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527869952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.009968:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527869952:12345-0@lo:400:kworker.0 Request processed in 62us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.009975:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789479992.009989:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789479992.009997:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527870464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.010032:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869824 00000100:00100000:2.0:1789479992.010034:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527870464:12345-0@lo:400:kworker.0 Request processed in 37us (3337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.010042:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869824 00000100:00100000:2.0:1789479992.010043:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789479992.010069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870336 00000100:00100000:3.0:1789479992.010073:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870336 00000100:00100000:2.0:1789479992.010078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869568 00000100:00100000:2.0:1789479992.010085:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869568 00000100:00100000:3.0:1789479992.010095:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789479992.010105:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527869184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.010113:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869312 00000100:00100000:2.0:1789479992.010117:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869312 00000100:00100000:2.0:1789479992.010131:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870720 00000100:00100000:2.0:1789479992.010136:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870720 00000100:00100000:2.0:1789479992.010152:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789479992.010161:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527869568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.010173:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527869184:12345-0@lo:400:kworker.0 Request processed in 69us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.010183:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789479992.010215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789479992.010224:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527869696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.010272:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527869568:12345-0@lo:400:kworker.0 Request processed in 112us (4215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.010274:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527869696:12345-0@lo:400:kworker.0 Request processed in 51us (4551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.010289:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789479992.010289:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789479992.010313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789479992.010319:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527870208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.010351:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527870208:12345-0@lo:400:kworker.0 Request processed in 32us (4585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.010357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789479992.010370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789479992.010375:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527869440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.010521:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789479992.010530:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527869312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.010565:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527869312:12345-0@lo:400:kworker.0 Request processed in 37us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.010571:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789479992.010582:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789479992.010588:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527870720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789479992.010691:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479992.010743:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527870720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.010750:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789479992.010774:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527869056 00000100:00100000:2.0:1789479992.010778:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527869056 00000100:00100000:2.0:1789479992.010812:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789479992.010821:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527869056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789479992.010843:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527870720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789479992.010859:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527869056:12345-0@lo:400:kworker.0 Request processed in 40us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.010867:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1789479992.011028:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789479992.011037:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527869824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011073:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527869824:12345-0@lo:400:kworker.0 Request processed in 38us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.011090:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789479992.011106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789479992.011113:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527870336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011147:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527870336:12345-0@lo:400:kworker.0 Request processed in 36us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.011153:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1789479992.011178:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789479992.011184:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789479992.011262:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789479992.011267:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789479992.011525:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527869056:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011541:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527869568:0@lo:400:kworker.0 00010000:00080000:2.0:1789479992.011560:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862fa300 x1876405527870080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479992.011573:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527870080:0@lo:400:kworker.0 00010000:00080000:2.0:1789479992.011587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e680 x1876405527870592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479992.011595:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527870592:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011608:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527869184:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011702:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527869696:0@lo:400:kworker.0 00000100:00100000:2.0:1789479992.011718:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527870208:0@lo:400:kworker.0 00000100:00100000:1.0:1789479992.012565:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527869312:0@lo:400:kworker.0 00010000:00080000:1.0:1789479992.012583:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6aaa2e1880 x1876405527869824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.012595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527869824:0@lo:400:kworker.0 00010000:00080000:1.0:1789479992.012607:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e300 x1876405527870336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.012617:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527870336:0@lo:400:kworker.0 00000100:00100000:1.0:1789479992.012632:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527869440:0@lo:400:kworker.0 00010000:00080000:1.0:1789479992.012659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a862f8a80 x1876405527869952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.012668:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527869952:0@lo:400:kworker.0 00010000:00080000:1.0:1789479992.012682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1dc00 x1876405527870464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.012691:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527870464:0@lo:400:kworker.0 00000100:00100000:3.0:1789479992.013519:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527869440:12345-0@lo:400:kworker.0 Request processed in 29us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479992.013532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789479992.521217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527870848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789479992.521306:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479992.521400:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870848 00000100:00100000:1.0:1789479992.521410:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870848 00000100:00100000:1.0:1789479992.521473:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789479992.521484:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527870848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789479992.521536:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479992.521589:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527870848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479992.521597:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1789479992.521658:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6680 x1876405527870848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789479992.521680:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527870848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789479992.529802:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789479992.529844:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527870976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789479992.529945:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479992.530025:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527870976 00000100:00100000:2.0:1789479992.530035:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527870976 00000100:00100000:2.0:1789479992.530090:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789479992.530099:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527870976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789479992.530126:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479992.530174:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527870976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479992.530182:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789479992.530257:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669f800 x1876405527870976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479992.530279:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527870976:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479992.646175:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479993.681889:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789479994.564564:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a8669f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527871104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789479994.565095:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789479994.565206:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789479994.565214:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527871232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789479994.565241:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479994.565306:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871104 00000100:00100000:1.0:1789479994.565316:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871104 00000100:00100000:2.0:1789479994.565326:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871232 00000100:00100000:2.0:1789479994.565332:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871232 00000100:00100000:1.0:1789479994.565383:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789479994.565394:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527871104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789479994.565426:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479994.565603:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527871104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 211us (508us total) trans 0 rc 0/0 00010000:00080000:3.0:1789479994.565686:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a8669f800 x1876405527871104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479994.565705:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a8669f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527871104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789479994.565794:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789479994.565806:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527871232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789479994.565819:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479994.565864:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527871232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (622us total) trans 0 rc 0/0 00010000:00080000:3.0:1789479994.565914:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ce6680 x1876405527871232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479994.565929:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527871232:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789479994.566138:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789479994.567441:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789479994.567700:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:0.0:1789479994.692465:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789479995.077276:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789479995.077302:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527871360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789479995.077378:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479995.077575:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871360 00000100:00100000:3.0:1789479995.077586:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871360 00000100:00100000:3.0:1789479995.077649:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789479995.077659:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527871360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789479995.077696:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789479995.077757:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527871360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479995.077764:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789479995.078613:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527871360:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789479995.223343:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223420:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223461:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223484:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223498:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789479995.223536:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789479995.223648:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865984 00000100:00100000:0.0:1789479995.223658:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865984 00000100:00100000:3.0:1789479995.223693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865728 00000100:00100000:3.0:1789479995.223698:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865728 00000100:00100000:0.0:1789479995.223710:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866240 00000100:00100000:0.0:1789479995.223712:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866240 00000100:00100000:0.0:1789479995.223722:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507865856 00000100:00100000:3.0:1789479995.223724:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 312 00000100:00100000:0.0:1789479995.223724:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507865856 00000100:00100000:3.0:1789479995.223732:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507865728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479995.223735:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866112 00000100:00100000:0.0:1789479995.223736:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866112 00000100:00100000:0.0:1789479995.223748:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:0.0:1789479995.223754:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507865984:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789479995.223840:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507865728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 107us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479995.223847:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 312 00000100:00100000:3.0:1789479995.223882:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:3.0:1789479995.223889:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866240:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789479995.223925:0:6520:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789479995.223934:0:6520:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789479995.223950:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866496 00000100:00100000:2.0:1789479995.223953:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866496 00000100:00100000:2.0:1789479995.223977:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866368 00000100:00100000:2.0:1789479995.223980:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866368 00000100:00100000:2.0:1789479995.224015:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:2.0:1789479995.224022:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866496:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479995.224069:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507865984:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 314us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479995.224077:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:0.0:1789479995.224090:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:0.0:1789479995.224096:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507865856:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479995.224120:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507865856:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479995.224125:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:0.0:1789479995.224135:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:0.0:1789479995.224141:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866112:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789479995.224162:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866112:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479995.224177:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00080000:1.0:1789479995.227433:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789479995.227441:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789479995.227445:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789479995.227449:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789479995.227499:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:1.0:1789479995.227517:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866368:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789479995.227588:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866368:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 79us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479995.227597:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866240:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 3704us (4172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479995.227607:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:1.0:1789479995.227612:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:2.0:1789479995.227648:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2402:x1876405507866496:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 3624us (4183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479995.227657:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00010000:00010000:0.0:1789479995.717080:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789479996.102714:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:0.0:1789479996.105100:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:2.0:1789479996.111874:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:1.0:1789479996.115019:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00010000:00010000:0.0:1789479996.743842:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789479996.954053:0:12195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1789479997.124381:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527871488:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789479997.124554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479997.125440:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871488 00000100:00100000:2.0:1789479997.125451:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871488 00000100:00100000:2.0:1789479997.125499:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789479997.125509:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527871488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789479997.125543:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789479997.131804:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527871488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6286us (7239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.131818:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789479997.131864:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527871872:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.131921:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479997.131972:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871872 00000100:00100000:2.0:1789479997.131980:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871872 00000100:00100000:2.0:1789479997.132021:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789479997.132028:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527871872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.132076:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527871872:12345-0@lo:400:kworker.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.132082:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789479997.132116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527871872:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.132287:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527871616:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.133400:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.133443:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479997.133452:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527871744:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.133479:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.133525:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871744 00000100:00100000:3.0:1789479997.133531:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871744 00000100:00100000:3.0:1789479997.133642:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789479997.133650:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527871744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.133693:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527871744:12345-0@lo:400:kworker.0 Request processed in 43us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.133699:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789479997.133733:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527871744:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.134075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527872128:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.134098:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.134126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872128 00000100:00100000:3.0:1789479997.134131:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872128 00000100:00100000:3.0:1789479997.134159:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789479997.134166:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527872128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.134221:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527872128:12345-0@lo:400:kworker.0 Request processed in 55us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.134227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:3.0:1789479997.134243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479997.134263:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527872128:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.134293:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527872256:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135564:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527871616 00000100:00100000:2.0:1789479997.135575:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527871616 00000100:00100000:2.0:1789479997.135636:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789479997.135645:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527871616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.135689:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479997.135697:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527871616:12345-0@lo:400:kworker.0 Request processed in 54us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.135704:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789479997.135732:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872256 00000100:00100000:2.0:1789479997.135735:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872256 00000100:00100000:3.0:1789479997.135736:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527871616:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135764:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789479997.135770:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527872256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.135787:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527872640:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135798:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527872256:12345-0@lo:400:kworker.0 Request processed in 28us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.135803:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789479997.135806:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479997.135812:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872640 00000100:00100000:2.0:1789479997.135815:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872640 00000100:00100000:2.0:1789479997.135835:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00010000:00080000:3.0:1789479997.135836:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b0380 x1876405527872256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789479997.135840:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527872640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.135857:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527872256:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135869:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527872640:12345-0@lo:400:kworker.0 Request processed in 29us (61us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.135875:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1789479997.135887:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789479997.135888:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527872768:0@lo:400:kworker.0 00000100:00080000:2.0:1789479997.135891:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789479997.135910:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789479997.135910:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527872640:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527872384:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.135931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872768 00000100:00100000:3.0:1789479997.135935:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872768 00000100:00100000:2.0:1789479997.135951:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.135959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789479997.135964:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527872768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.135976:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789479997.135983:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527872000:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.135994:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527872768:12345-0@lo:400:kworker.0 Request processed in 30us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.136000:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789479997.136001:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.136010:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872000 00000100:00100000:3.0:1789479997.136013:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872000 00000100:00100000:2.0:1789479997.136014:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527872512:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136029:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789479997.136032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.136034:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527872000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.136053:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872384 00000100:00100000:2.0:1789479997.136056:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872384 00000100:00100000:3.0:1789479997.136062:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527872000:12345-0@lo:400:kworker.0 Request processed in 27us (60us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.136067:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789479997.136079:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872512 00000100:00100000:2.0:1789479997.136081:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872512 00010000:00080000:3.0:1789479997.136090:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbd500 x1876405527872768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.136099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527872768:0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.136099:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789479997.136104:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527872384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136115:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789479997.136120:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527872512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789479997.136131:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527872384:12345-0@lo:400:kworker.0 Request processed in 27us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.136136:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789479997.136143:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527872512:12345-0@lo:400:kworker.0 Request processed in 23us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.136157:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1789479997.136171:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789479997.136174:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789479997.136203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527872000:0@lo:400:kworker.0 00010000:00080000:3.0:1789479997.136213:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbf100 x1876405527872512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.136220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527872512:0@lo:400:kworker.0 00010000:00080000:3.0:1789479997.136229:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527872384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.136235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527872384:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136262:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527872896:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136282:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.136304:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527872896 00000100:00100000:3.0:1789479997.136307:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527872896 00000100:00100000:3.0:1789479997.136329:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789479997.136334:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527872896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136363:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527872896:12345-0@lo:400:kworker.0 Request processed in 29us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.136367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1789479997.136380:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789479997.136394:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527872896/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.136403:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527872896:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136939:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789479997.136955:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527873024:0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.136984:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.137013:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873024 00000100:00100000:3.0:1789479997.137018:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873024 00000100:00100000:3.0:1789479997.137049:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789479997.137056:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527873024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789479997.137091:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527873024:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789479997.137097:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789479997.137113:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789479997.137131:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6985dbc000 x1876405527873024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479997.137141:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527873024:0@lo:400:kworker.0 00000100:00100000:0.0:1789479997.140764:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527871488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789479997.636516:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527873152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789479997.636578:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479997.636664:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789479997.636671:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527873280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789479997.636696:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479997.636723:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873152 00000100:00100000:1.0:1789479997.636731:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873152 00000100:00100000:1.0:1789479997.636778:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873280 00000100:00100000:1.0:1789479997.636782:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873280 00000100:00100000:1.0:1789479997.636799:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789479997.636808:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527873152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789479997.636834:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789479997.636851:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789479997.636860:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527873280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789479997.636871:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789479997.636889:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527873152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479997.636896:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789479997.636897:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527873280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789479997.636902:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1789479997.636976:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbc380 x1876405527873280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479997.636993:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527873280:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789479997.637005:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e300 x1876405527873152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789479997.637014:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527873152:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789479997.769300:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789479998.788535:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789479999.684450:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527873536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789479999.684520:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789479999.684594:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527873408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789479999.684630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789479999.691964:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873536 00000100:00100000:1.0:1789479999.691978:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873536 00000100:00100000:1.0:1789479999.692068:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873408 00000100:00100000:1.0:1789479999.692072:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873408 00000100:00100000:1.0:1789479999.692094:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789479999.692103:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527873536:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789479999.692104:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789479999.692133:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479999.692184:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789479999.692222:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527873408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789479999.692233:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789479999.692272:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527873408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (7642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789479999.692279:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1789479999.692369:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbf100 x1876405527873408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479999.692389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527873408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789479999.692934:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527873536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 830us (8412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789479999.692946:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789479999.693098:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e680 x1876405527873536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789479999.693112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527873536:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789479999.812440:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480000.197907:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527873664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480000.198665:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480000.200003:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873664 00000100:00100000:2.0:1789480000.200033:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873664 00000100:00100000:2.0:1789480000.200104:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789480000.200131:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527873664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480000.200204:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789480000.211306:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527873664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 11185us (12634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480000.211338:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789480000.211449:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527873664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480000.344551:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344590:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344622:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344646:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344677:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344692:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480000.344744:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866752 00000100:00100000:2.0:1789480000.344753:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866752 00000100:00100000:2.0:1789480000.344803:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867008 00000100:00100000:2.0:1789480000.344807:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867008 00000100:00100000:2.0:1789480000.344820:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866880 00000100:00100000:2.0:1789480000.344823:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866880 00000100:00100000:2.0:1789480000.344833:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867136 00000100:00100000:2.0:1789480000.344836:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867136 00000100:00100000:2.0:1789480000.344852:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:2.0:1789480000.344875:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507866752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480000.344952:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507866752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 91us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480000.344960:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:2.0:1789480000.344977:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:2.0:1789480000.344983:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480000.345004:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480000.345010:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:2.0:1789480000.345047:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:2.0:1789480000.345054:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507866880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480000.345251:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507866880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 197us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480000.345258:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:2.0:1789480000.345270:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:2.0:1789480000.345276:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480000.345300:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480000.345306:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:3.0:1789480000.345467:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867264 00000100:00100000:3.0:1789480000.345472:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867264 00000100:00100000:3.0:1789480000.345502:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867392 00000100:00100000:3.0:1789480000.345505:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867392 00000100:00100000:3.0:1789480000.345525:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789480000.345533:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480000.345559:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480000.345565:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789480000.345577:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:3.0:1789480000.345583:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480000.345615:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507867392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480000.345622:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00080000:3.0:1789480000.345643:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480000.345647:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480000.345649:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480000.345651:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480000.346278:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507866624 00000100:00100000:1.0:1789480000.346284:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507866624 00000100:00100000:1.0:1789480000.346320:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 314 00000100:00100000:1.0:1789480000.346329:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507866624:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480000.346382:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507866624:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 54us (1735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480000.346389:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 314 00010000:00010000:2.0:1789480000.836307:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480001.860944:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480002.245017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527873920:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245079:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245137:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527874432:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245160:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245212:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527874944:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245233:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245257:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789480002.245262:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527873792:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245284:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245302:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527874304:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245321:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245334:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527874816:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245351:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245363:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245378:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480002.245401:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873920 00000100:00100000:3.0:1789480002.245407:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873920 00000100:00100000:3.0:1789480002.245439:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874432 00000100:00100000:3.0:1789480002.245442:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874432 00000100:00100000:3.0:1789480002.245461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874944 00000100:00100000:3.0:1789480002.245463:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874944 00000100:00100000:3.0:1789480002.245476:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789480002.245483:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527873920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245529:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527873920:12345-0@lo:400:kworker.0 Request processed in 46us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245536:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789480002.245551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789480002.245557:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527874432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245580:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527874432:12345-0@lo:400:kworker.0 Request processed in 24us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245586:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789480002.245621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789480002.245626:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527874944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245652:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527874944:12345-0@lo:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789480002.245675:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527873792 00000100:00100000:3.0:1789480002.245678:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527873792 00000100:00100000:3.0:1789480002.245700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789480002.245705:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527873792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245729:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527873792:12345-0@lo:400:kworker.0 Request processed in 24us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789480002.245754:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874304 00000100:00100000:3.0:1789480002.245757:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874304 00000100:00100000:3.0:1789480002.245776:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789480002.245781:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527874304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245806:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527874304:12345-0@lo:400:kworker.0 Request processed in 25us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245812:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789480002.245826:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874816 00000100:00100000:3.0:1789480002.245829:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874816 00000100:00100000:3.0:1789480002.245847:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875328 00000100:00100000:3.0:1789480002.245849:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875328 00000100:00100000:3.0:1789480002.245862:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789480002.245868:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527874816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245892:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527874816:12345-0@lo:400:kworker.0 Request processed in 24us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245906:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789480002.245917:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789480002.245923:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.245947:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875328:12345-0@lo:400:kworker.0 Request processed in 25us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480002.245953:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789480002.245974:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480002.245978:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480002.245981:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480002.246018:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527873792:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.246029:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527874304:0@lo:400:kworker.0 00010000:00080000:3.0:1789480002.246039:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f9f80 x1876405527874816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480002.246049:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527874816:0@lo:400:kworker.0 00010000:00080000:3.0:1789480002.246057:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d28a80 x1876405527875328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480002.246065:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.246073:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527873920:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.246079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527874432:0@lo:400:kworker.0 00000100:00100000:3.0:1789480002.246087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527874944:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246270:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527874176:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246298:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246317:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527874688:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246336:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246354:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527875200:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246388:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789480002.246393:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527874048:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246424:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527874560:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246440:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246450:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527875072:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.246492:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874048 00000100:00100000:0.0:1789480002.246496:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874048 00000100:00100000:0.0:1789480002.246517:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789480002.246523:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527874048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246553:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527874048:12345-0@lo:400:kworker.0 Request processed in 30us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246558:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789480002.246572:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874176 00000100:00100000:0.0:1789480002.246575:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874176 00000100:00100000:0.0:1789480002.246615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874560 00000100:00100000:0.0:1789480002.246618:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874560 00000100:00100000:0.0:1789480002.246635:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875072 00000100:00100000:0.0:1789480002.246637:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875072 00000100:00100000:0.0:1789480002.246648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789480002.246653:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527874176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246680:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527874176:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246686:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789480002.246695:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789480002.246700:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527874560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246720:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527874560:12345-0@lo:400:kworker.0 Request processed in 20us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246725:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789480002.246736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789480002.246742:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527875072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246768:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527875072:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789480002.246790:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527874688 00000100:00100000:0.0:1789480002.246793:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527874688 00000100:00100000:0.0:1789480002.246809:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875200 00000100:00100000:0.0:1789480002.246811:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875200 00000100:00100000:0.0:1789480002.246823:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789480002.246828:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527874688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246852:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527874688:12345-0@lo:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246866:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789480002.246876:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789480002.246881:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527875200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.246906:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527875200:12345-0@lo:400:kworker.0 Request processed in 25us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.246911:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789480002.246950:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480002.246953:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480002.246955:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480002.246974:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527874048:0@lo:400:kworker.0 00010000:00080000:0.0:1789480002.246984:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866fb480 x1876405527874560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.246994:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527874560:0@lo:400:kworker.0 00010000:00080000:0.0:1789480002.247001:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866fb100 x1876405527875072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.247009:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527875072:0@lo:400:kworker.0 00000100:00100000:0.0:1789480002.247017:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527874176:0@lo:400:kworker.0 00010000:00080000:0.0:1789480002.247025:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f9180 x1876405527874688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.247032:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527874688:0@lo:400:kworker.0 00010000:00080000:0.0:1789480002.247040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f9500 x1876405527875200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.247047:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527875200:0@lo:400:kworker.0 00000100:00100000:2.0:1789480002.247393:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480002.247421:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.247677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875456 00000100:00100000:0.0:1789480002.247682:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875456 00000100:00100000:0.0:1789480002.247710:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789480002.247716:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480002.247739:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480002.247869:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480002.247877:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789480002.247926:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480002.764357:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527875584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480002.764517:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480002.764584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527875712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480002.764628:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480002.764702:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875584 00000100:00100000:0.0:1789480002.764710:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875584 00000100:00100000:0.0:1789480002.764759:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875712 00000100:00100000:0.0:1789480002.764762:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875712 00000100:00100000:0.0:1789480002.764790:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789480002.764799:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527875584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480002.764826:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480002.764868:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789480002.764875:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527875584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480002.764882:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527875712:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480002.764887:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00002000:00000024:1.0:1789480002.764899:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480002.764947:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527875712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480002.764953:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1789480002.764991:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbf100 x1876405527875584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480002.765010:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527875584:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789480002.765016:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d28000 x1876405527875712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480002.765033:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527875712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789480002.884281:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480003.908319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789480004.525111:0:12511:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789480004.525835:0:12511:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789480004.804439:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480004.804462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480004.804525:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480004.804654:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875840 00000100:00100000:1.0:1789480004.804662:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875840 00000100:00100000:1.0:1789480004.804718:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789480004.804727:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480004.804786:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480004.804834:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527875840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480004.804841:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1789480004.804882:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbf100 x1876405527875840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480004.804899:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527875840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789480004.805056:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480004.805256:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527875968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480004.805291:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480004.805411:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527875968 00000100:00100000:2.0:1789480004.805416:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527875968 00000100:00100000:2.0:1789480004.805458:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789480004.805466:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527875968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480004.805478:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480004.805523:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527875968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480004.805539:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789480004.805601:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789480004.805658:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d28e00 x1876405527875968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480004.805679:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527875968:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789480004.939491:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480005.331183:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480005.331242:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527876096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480005.331313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480005.331968:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876096 00000100:00100000:3.0:1789480005.331977:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876096 00000100:00100000:3.0:1789480005.332029:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789480005.332038:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527876096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480005.332071:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480005.332135:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527876096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.332141:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789480005.333388:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527876096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480005.468868:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.468902:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.468925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.468948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.468968:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.468988:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.469012:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480005.469040:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867520 00000100:00100000:3.0:1789480005.469063:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867520 00000100:00100000:3.0:1789480005.469279:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 316 00000100:00100000:3.0:1789480005.469291:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507867520:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.469730:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507867520:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 441us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.469739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 316 00000100:00100000:3.0:1789480005.469775:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867776 00000100:00100000:3.0:1789480005.469779:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867776 00000100:00100000:3.0:1789480005.469828:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868032 00000100:00100000:3.0:1789480005.469832:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868032 00000100:00100000:3.0:1789480005.469847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867648 00000100:00100000:3.0:1789480005.469849:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867648 00000100:00100000:3.0:1789480005.469861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507867904 00000100:00100000:3.0:1789480005.469863:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507867904 00000100:00100000:3.0:1789480005.469878:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:3.0:1789480005.469884:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507867776:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.469916:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507867776:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.469921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:3.0:1789480005.469932:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1789480005.469937:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868032:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.469961:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868032:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.469966:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1789480005.469978:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:3.0:1789480005.469984:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507867648:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.470006:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507867648:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.470012:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:3.0:1789480005.470023:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:3.0:1789480005.470029:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507867904:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.470066:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507867904:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.472764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:3.0:1789480005.472809:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868288 00000100:00100000:3.0:1789480005.472817:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868288 00000100:00100000:3.0:1789480005.472858:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868160 00000100:00100000:3.0:1789480005.472861:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868160 00000100:00100000:3.0:1789480005.472885:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:3.0:1789480005.472893:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868288:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.472956:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868288:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.472962:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:3.0:1789480005.472974:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:3.0:1789480005.472980:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868160:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480005.473000:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868160:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480005.473005:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00080000:3.0:1789480005.473035:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480005.473052:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480005.473055:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480005.473058:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789480005.958926:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480006.982355:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789480007.350116:0:12608:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789480007.350909:0:12608:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789480007.365526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527876608:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.365547:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527876480:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.365635:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.365653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.365704:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527876992:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.365721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876608 00000100:00100000:3.0:1789480007.365731:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.365731:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876608 00000100:00100000:3.0:1789480007.365761:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527877504:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.365786:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480007.365792:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789480007.365805:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527876608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.365830:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789480007.365838:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527876224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480007.366022:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527876352:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.366287:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527876864:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366309:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.366320:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527877376:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366339:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.366361:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527877888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366380:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.366406:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876480 00000100:00100000:3.0:1789480007.366410:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876480 00000100:00100000:3.0:1789480007.366744:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876992 00000100:00100000:3.0:1789480007.366749:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876992 00000100:00100000:3.0:1789480007.366775:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877504 00000100:00100000:3.0:1789480007.366778:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877504 00000100:00100000:3.0:1789480007.366794:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789480007.366801:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527876480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366843:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527876480:12345-0@lo:400:kworker.0 Request processed in 42us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.366849:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789480007.366867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789480007.366873:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527876992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366898:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527876992:12345-0@lo:400:kworker.0 Request processed in 27us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.366902:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789480007.366913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789480007.366919:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527877504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.366957:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527877504:12345-0@lo:400:kworker.0 Request processed in 39us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.366962:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789480007.366982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876224 00000100:00100000:3.0:1789480007.366985:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876224 00000100:00100000:3.0:1789480007.366997:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876864 00000100:00100000:3.0:1789480007.366998:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876864 00000100:00100000:3.0:1789480007.367006:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789480007.367011:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527876224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480007.367034:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789480007.367061:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527876224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.367066:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789480007.367077:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789480007.367083:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527876864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.367110:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527876864:12345-0@lo:400:kworker.0 Request processed in 28us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.367114:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789480007.367137:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877376 00000100:00100000:3.0:1789480007.367140:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877376 00000100:00100000:3.0:1789480007.367162:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877888 00000100:00100000:3.0:1789480007.367165:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877888 00000100:00100000:3.0:1789480007.367181:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789480007.367187:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527877376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.367239:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527877376:12345-0@lo:400:kworker.0 Request processed in 52us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.367244:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789480007.370908:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789480007.370926:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527877888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.371499:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527876608:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.371512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527877120:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.371579:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.371611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527877632:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.371633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.372141:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877120 00000100:00100000:1.0:1789480007.372148:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877120 00000100:00100000:1.0:1789480007.372188:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877632 00000100:00100000:1.0:1789480007.372224:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877632 00000100:00100000:1.0:1789480007.372243:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789480007.372249:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527877120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.372296:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527877120:12345-0@lo:400:kworker.0 Request processed in 47us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.372318:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789480007.372334:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789480007.372339:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527877632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.372366:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527877632:12345-0@lo:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.372372:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00080000:1.0:1789480007.372404:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb506300 x1876405527877120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.372415:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527877120:0@lo:400:kworker.0 00010000:00080000:1.0:1789480007.372425:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb506d80 x1876405527877632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.372433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527877632:0@lo:400:kworker.0 00000100:00100000:2.0:1789480007.372594:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527876608:12345-0@lo:400:kworker.0 Request processed in 6791us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480007.372603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789480007.372802:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527877888:12345-0@lo:400:kworker.0 Request processed in 1880us (6418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.372810:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1789480007.372837:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480007.372842:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480007.372845:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480007.372847:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480007.372883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527876224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480007.372894:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527876864:0@lo:400:kworker.0 00010000:00080000:3.0:1789480007.372905:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb505180 x1876405527877376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480007.372914:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527877376:0@lo:400:kworker.0 00010000:00080000:3.0:1789480007.372924:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504000 x1876405527877888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480007.372931:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527877888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.374143:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527876480:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.376599:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527876992:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.376615:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527877504:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.394424:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.395512:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527876736:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.395560:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.395604:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876736 00000100:00100000:1.0:1789480007.395612:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876736 00000100:00100000:1.0:1789480007.395654:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789480007.395676:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527876736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.395722:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527876736:12345-0@lo:400:kworker.0 Request processed in 48us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.395730:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789480007.399454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527876736:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.399475:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527877248:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.399583:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.401507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527877760:0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.401555:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.401604:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877248 00000100:00100000:1.0:1789480007.401612:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877248 00000100:00100000:1.0:1789480007.401673:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527877760 00000100:00100000:1.0:1789480007.401676:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527877760 00000100:00100000:1.0:1789480007.401700:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789480007.401708:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527877248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.401837:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527877248:12345-0@lo:400:kworker.0 Request processed in 129us (2256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.401845:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789480007.401861:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789480007.401868:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527877760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480007.401893:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527877760:12345-0@lo:400:kworker.0 Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.401899:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789480007.401916:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480007.401919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480007.401947:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb507480 x1876405527877760/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.401959:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527877760:0@lo:400:kworker.0 00010000:00080000:1.0:1789480007.402316:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb506680 x1876405527877248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.402327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527877248:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.402651:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527876352 00000100:00100000:3.0:1789480007.402657:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527876352 00000100:00100000:3.0:1789480007.404357:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1789480007.404369:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527876352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.404462:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527876352:12345-0@lo:400:kworker.0 Request processed in 95us (10046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480007.404470:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789480007.404548:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527876352:0@lo:400:kworker.0 00000100:00100000:3.0:1789480007.876425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527878016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480007.876489:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480007.876582:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878016 00000100:00100000:3.0:1789480007.876589:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878016 00000100:00100000:2.0:1789480007.876716:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789480007.876727:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527878016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480007.876756:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480007.876826:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527878016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480007.876834:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1789480007.876916:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0dc00 x1876405527878016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480007.876983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527878016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480007.877586:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527878144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480007.877624:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480007.877718:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878144 00000100:00100000:1.0:1789480007.877724:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878144 00000100:00100000:1.0:1789480007.877760:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789480007.877776:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527878144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789480007.877791:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480007.877838:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527878144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480007.877846:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789480007.878110:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d29880 x1876405527878144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480007.878126:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527878144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789480008.005761:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480009.028698:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480009.927080:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480009.927140:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527878400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480009.927231:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480009.927288:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878400 00000100:00100000:3.0:1789480009.927295:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878400 00000100:00100000:3.0:1789480009.927343:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789480009.927351:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527878400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480009.927376:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480009.927431:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527878400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480009.927437:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1789480009.927457:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789480009.927483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504000 x1876405527878400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480009.927500:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527878400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480009.927514:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527878272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480009.927543:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480009.928728:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878272 00000100:00100000:3.0:1789480009.928737:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878272 00000100:00100000:3.0:1789480009.928801:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789480009.928809:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527878272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480009.928834:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480009.928880:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527878272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480009.928887:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789480009.929040:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d2b800 x1876405527878272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480009.929057:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527878272:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789480009.929532:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1789480010.045164:0:12706:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480010.045386:0:12706:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789480010.052586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480010.437478:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480010.437500:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527878528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480010.437620:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480010.437909:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878528 00000100:00100000:3.0:1789480010.437917:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878528 00000100:00100000:0.0:1789480010.438031:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789480010.438052:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527878528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480010.438085:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789480010.438139:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527878528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480010.438146:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789480010.438256:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527878528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480010.581875:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480010.581917:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480010.582051:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869056 00000100:00100000:0.0:1789480010.582066:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869056 00000100:00100000:0.0:1789480010.582128:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869184 00000100:00100000:0.0:1789480010.582131:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869184 00000100:00100000:0.0:1789480010.582154:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:0.0:1789480010.582164:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2398:x1876405507869056:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:0.0:1789480010.582227:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d345 00000100:00080000:0.0:1789480010.582236:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789480010.582276:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:3.0:1789480010.582438:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480010.582442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480010.582471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:3.0:1789480010.582479:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2398:x1876405507869184:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1789480010.582492:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d34c 00000100:00080000:3.0:1789480010.582498:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480010.582527:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789480010.582663:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:71ef009f-7b67-4186-8594-2437af8601ad+2:2398:x1876405507869184:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 184us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480010.582670:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00010000:00010000:3.0:1789480010.582692:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480010.583128:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:71ef009f-7b67-4186-8594-2437af8601ad+2:2398:x1876405507869056:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 965us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480010.583135:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00010000:00010000:0.0:1789480010.583152:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480010.584045:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480010.584166:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480010.584448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480010.584470:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480010.584577:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868544 00000100:00100000:1.0:1789480010.584585:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868544 00000100:00100000:1.0:1789480010.584643:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868800 00000100:00100000:1.0:1789480010.584646:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868800 00000100:00100000:1.0:1789480010.584667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:1.0:1789480010.584674:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507868544:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480010.584724:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507868544:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 50us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480010.584730:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:1.0:1789480010.584744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:1.0:1789480010.584751:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868800:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480010.584773:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868800:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480010.584779:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:3.0:1789480010.585338:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480010.585578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868416 00000100:00100000:3.0:1789480010.585584:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868416 00000100:00100000:3.0:1789480010.585681:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 318 00000100:00100000:3.0:1789480010.585690:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507868416:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480010.585734:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507868416:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 45us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480010.585740:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 318 00000100:00100000:3.0:1789480010.585767:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868672 00000100:00100000:3.0:1789480010.585771:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868672 00000100:00100000:3.0:1789480010.585795:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507868928 00000100:00100000:3.0:1789480010.585799:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507868928 00000100:00100000:3.0:1789480010.585815:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:3.0:1789480010.585821:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507868672:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480010.585847:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507868672:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480010.585853:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:3.0:1789480010.585864:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:3.0:1789480010.585870:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868928:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480010.585905:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507868928:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480010.585910:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00080000:3.0:1789480010.585934:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480010.585938:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480011.079840:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480012.100737:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480012.484364:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480012.484384:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527878656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480012.484446:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480012.484507:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878656 00000100:00100000:2.0:1789480012.484515:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878656 00000100:00100000:2.0:1789480012.484576:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789480012.484585:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527878656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480012.484617:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480012.484659:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527878656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480012.484666:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789480012.484708:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527878656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480012.485167:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527879040:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.485219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480012.485239:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527879552:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.485264:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480012.485284:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527880064:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485439:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527879168:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485524:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485558:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527879680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485580:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485603:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527880192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485635:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485656:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789480012.485662:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527878784:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485706:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527879296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485727:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485755:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527879808:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485775:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.485802:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879040 00000100:00100000:3.0:1789480012.485808:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879040 00000100:00100000:3.0:1789480012.485837:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789480012.485844:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527879040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.485882:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527879040:12345-0@lo:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.485888:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789480012.485907:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879552 00000100:00100000:3.0:1789480012.486049:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879552 00000100:00100000:3.0:1789480012.486097:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879680 00000100:00100000:3.0:1789480012.486101:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879680 00000100:00100000:3.0:1789480012.486113:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880192 00000100:00100000:3.0:1789480012.486115:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880192 00000100:00100000:3.0:1789480012.486127:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789480012.486133:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.486165:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527879552:12345-0@lo:400:kworker.0 Request processed in 32us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.486171:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789480012.486455:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789480012.486470:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.486506:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527879680:12345-0@lo:400:kworker.0 Request processed in 38us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.486512:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789480012.486523:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789480012.486529:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527880192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.486567:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527880192:12345-0@lo:400:kworker.0 Request processed in 39us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.486573:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789480012.486591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879168 00000100:00100000:3.0:1789480012.486594:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879168 00000100:00100000:3.0:1789480012.486615:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879296 00000100:00100000:3.0:1789480012.486618:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879296 00000100:00100000:3.0:1789480012.486636:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879808 00000100:00100000:3.0:1789480012.486639:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879808 00000100:00100000:3.0:1789480012.486652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789480012.486658:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527879168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.486687:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527879168:12345-0@lo:400:kworker.0 Request processed in 30us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.486693:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789480012.486704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789480012.486710:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527879296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.486734:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527879296:12345-0@lo:400:kworker.0 Request processed in 25us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.486739:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789480012.486842:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480012.486882:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527879040:0@lo:400:kworker.0 00010000:00080000:0.0:1789480012.486896:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb037800 x1876405527879552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480012.486906:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb037800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527879552:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.486938:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789480012.486947:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527878912:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.486971:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480012.486994:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527879424:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.487015:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480012.487025:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527879936:0@lo:400:kworker.0 00000100:00100000:0.0:1789480012.487043:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480012.487372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878912 00000100:00100000:3.0:1789480012.487376:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878912 00000100:00100000:3.0:1789480012.487397:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879424 00000100:00100000:3.0:1789480012.487400:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879424 00000100:00100000:3.0:1789480012.487412:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527879936 00000100:00100000:3.0:1789480012.487415:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527879936 00000100:00100000:3.0:1789480012.487428:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789480012.487435:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527879808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.487470:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527879808:12345-0@lo:400:kworker.0 Request processed in 36us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.487476:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789480012.487488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789480012.487494:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527878912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.487531:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527878912:12345-0@lo:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.487537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789480012.487563:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789480012.487569:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527879424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.487597:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527879424:12345-0@lo:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.487602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789480012.487613:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789480012.487619:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527879936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.487646:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527879936:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.487651:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789480012.487669:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880064 00000100:00100000:3.0:1789480012.487672:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880064 00000100:00100000:3.0:1789480012.487689:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789480012.487701:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527880064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.487731:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527880064:12345-0@lo:400:kworker.0 Request processed in 31us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.487737:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789480012.487873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527878912:0@lo:400:kworker.0 00010000:00080000:0.0:1789480012.487885:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb034700 x1876405527879424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480012.487895:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb034700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527879424:0@lo:400:kworker.0 00010000:00080000:0.0:1789480012.487904:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d49c00 x1876405527879936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480012.487913:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527879936:0@lo:400:kworker.0 00010000:00080000:0.0:1789480012.487938:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4ad80 x1876405527880064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480012.487947:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527880064:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.488166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527878784 00000100:00100000:3.0:1789480012.488171:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527878784 00000100:00080000:2.0:1789480012.488256:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480012.488261:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480012.488264:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480012.488266:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480012.488496:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789480012.488504:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527878784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.488557:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527878784:12345-0@lo:400:kworker.0 Request processed in 54us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480012.488563:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789480012.488599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527878784:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.488611:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb037100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527879296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.488621:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb035c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527879808:0@lo:400:kworker.0 00000100:00100000:3.0:1789480012.488630:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527879168:0@lo:400:kworker.0 00010000:00080000:3.0:1789480012.488641:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb035500 x1876405527879680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480012.488650:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb035500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527879680:0@lo:400:kworker.0 00010000:00080000:3.0:1789480012.488660:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d4a680 x1876405527880192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480012.488669:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527880192:0@lo:400:kworker.0 00000020:00000004:3.0:1789480012.891183:0:12803:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789480012.891419:0:12803:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789480012.996356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480012.996375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527880320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480012.996436:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480012.996494:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880320 00000100:00100000:2.0:1789480012.996500:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880320 00000100:00100000:2.0:1789480012.996548:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789480012.996556:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527880320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480012.996580:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480012.996625:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527880320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480012.996643:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1789480012.996678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d2a300 x1876405527880320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480028 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480012.996694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527880320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480013.003545:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527880448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480013.003607:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480013.003811:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880448 00000100:00100000:2.0:1789480013.003820:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880448 00000100:00100000:2.0:1789480013.003870:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789480013.003879:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527880448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480013.003899:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480013.003966:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527880448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480013.003973:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1789480013.004050:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d2a300 x1876405527880448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480013.004068:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527880448:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789480013.124505:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480014.150648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789480015.013573:0:12900:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480015.013955:0:12900:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789480015.045388:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527880576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480015.045482:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480015.047704:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880576 00000100:00100000:2.0:1789480015.047717:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880576 00000100:00100000:2.0:1789480015.047792:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789480015.047801:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527880576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480015.047831:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480015.047904:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527880576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480015.047911:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:2.0:1789480015.047952:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d2a680 x1876405527880576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480015.047972:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527880576:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789480015.048142:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480015.051412:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480015.051435:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527880704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480015.051499:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480015.051683:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880704 00000100:00100000:3.0:1789480015.051692:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880704 00000100:00100000:3.0:1789480015.051750:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789480015.051760:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527880704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480015.051781:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480015.051827:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527880704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480015.051835:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1789480015.051872:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0dc00 x1876405527880704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480015.051891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527880704:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789480015.051940:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789480015.172510:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480015.556672:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527880832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480015.556808:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480015.557111:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880832 00000100:00100000:3.0:1789480015.557119:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880832 00000100:00100000:3.0:1789480015.557172:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789480015.557182:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527880832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480015.557235:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480015.558117:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527880832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 934us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480015.558127:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789480015.558356:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527880832:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480015.710994:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480015.711062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480015.711091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480015.711119:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480015.711143:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480015.711171:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869568 00000100:00100000:0.0:1789480015.711182:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869568 00000100:00100000:0.0:1789480015.711257:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869824 00000100:00100000:0.0:1789480015.711261:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869824 00000100:00100000:0.0:1789480015.711274:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869440 00000100:00100000:0.0:1789480015.711275:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869440 00000100:00100000:0.0:1789480015.711302:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869696 00000100:00100000:0.0:1789480015.711306:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869696 00000100:00100000:0.0:1789480015.711321:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:0.0:1789480015.711330:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507869568:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480015.711399:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507869568:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 69us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480015.711406:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:0.0:1789480015.711422:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:0.0:1789480015.711428:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507869824:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480015.711466:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507869824:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480015.711473:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:0.0:1789480015.711485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:0.0:1789480015.711491:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507869440:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480015.711513:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507869440:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480015.711519:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:0.0:1789480015.711544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 207 00000100:00100000:0.0:1789480015.711550:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507869696:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480015.711574:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507869696:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480015.711580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 207 00000100:00080000:0.0:1789480015.711603:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480015.711607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480015.712603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869312 00000100:00100000:3.0:1789480015.712612:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869312 00000100:00100000:3.0:1789480015.712706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 320 00000100:00100000:3.0:1789480015.712714:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507869312:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480015.712762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507869312:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 49us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480015.712778:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 320 00000001:00100000:2.0:1789480016.073955:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000020:00000080:2.0:1789480016.073973:0:8430:0:(genops.c:885:class_export_put()) final put ffff8a6986b0d800/71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:0.0:1789480016.076423:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000020:00000080:0.0:1789480016.076432:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6986b0d000/71ef009f-7b67-4186-8594-2437af8601ad 00000020:00000080:1.0:1789480016.076564:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b0d800/71ef009f-7b67-4186-8594-2437af8601ad for lustre-OST0000 00000020:00000080:1.0:1789480016.076709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b0d000/71ef009f-7b67-4186-8594-2437af8601ad for lustre-OST0001 00000020:00000080:1.0:1789480016.076799:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6986b0a000 for lustre-OST0000 00000020:00000080:1.0:1789480016.076805:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6986b0f800 for lustre-OST0001 00010000:00010000:0.0:1789480016.196996:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480017.227225:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480017.604651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527881216:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.604756:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.604823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527881728:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.604850:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.604867:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527882240:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.604887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.604920:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789480017.604926:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527881344:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.606028:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527881088:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.606762:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527880960:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.606838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.606897:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527881472:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.606927:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.606952:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527881984:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.608557:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.608568:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480017.608622:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527881600:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.608645:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527882496:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.608669:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.608699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.608817:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881728 00000100:00100000:2.0:1789480017.608826:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527882112:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.608832:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881728 00000100:00100000:2.0:1789480017.608868:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.608901:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882240 00000100:00100000:0.0:1789480017.608907:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882240 00000100:00100000:0.0:1789480017.608932:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881088 00000100:00100000:0.0:1789480017.608935:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881088 00000100:00100000:0.0:1789480017.608954:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881600 00000100:00100000:0.0:1789480017.608959:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881600 00000100:00100000:0.0:1789480017.608980:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882112 00000100:00100000:0.0:1789480017.608983:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882112 00000100:00100000:2.0:1789480017.608993:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789480017.609013:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789480017.609021:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527881728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.609033:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527882240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.609087:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527881728:12345-0@lo:400:kworker.0 Request processed in 81us (4233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480017.609098:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789480017.609104:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527882240:12345-0@lo:400:kworker.0 Request processed in 75us (4213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.609114:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789480017.609132:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789480017.609138:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527881088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.609167:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527881088:12345-0@lo:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.609172:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789480017.609182:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789480017.609188:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.609245:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527881600:12345-0@lo:400:kworker.0 Request processed in 57us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480017.609257:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789480017.609272:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527882112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.609314:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527882112:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.609822:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789480017.609833:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789480017.609873:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527880960 00000100:00100000:2.0:1789480017.609880:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527882624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480017.609894:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527880960 00000100:00100000:2.0:1789480017.609925:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480017.609954:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789480017.609976:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527880960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.609983:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527881088:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.610002:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527881600:0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.610015:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527882112:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.610035:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527880960:12345-0@lo:400:kworker.0 Request processed in 72us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.610045:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1789480017.610072:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881216 00000100:00100000:2.0:1789480017.610081:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881216 00000100:00100000:0.0:1789480017.610103:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881472 00000100:00100000:0.0:1789480017.610111:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881472 00000100:00100000:0.0:1789480017.610136:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882624 00000100:00100000:0.0:1789480017.610140:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882624 00000100:00100000:0.0:1789480017.610151:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789480017.610158:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527881216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.610221:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527881216:12345-0@lo:400:kworker.0 Request processed in 63us (5466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.610228:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789480017.610236:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789480017.610254:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789480017.610255:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527881472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.610282:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527882624:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480017.610312:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527881472:12345-0@lo:400:kworker.0 Request processed in 64us (3381us total) trans 0 rc 0/0 00000004:00000024:0.0:1789480017.610318:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480017.610323:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789480017.610374:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527882624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.610382:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789480017.610415:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881984 00000100:00100000:0.0:1789480017.610420:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881984 00000100:00100000:2.0:1789480017.610447:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527882624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480017.610465:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882496 00000100:00100000:0.0:1789480017.610474:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882496 00000100:00100000:2.0:1789480017.610481:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789480017.610494:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527881984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.610511:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789480017.610535:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527882496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480017.610560:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527881984:12345-0@lo:400:kworker.0 Request processed in 66us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480017.610569:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789480017.610594:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527882496:12345-0@lo:400:kworker.0 Request processed in 61us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.610611:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789480017.610645:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480017.610650:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480017.610653:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480017.610656:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480017.610695:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527880960:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.610710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527881472:0@lo:400:kworker.0 00010000:00080000:0.0:1789480017.610725:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9180 x1876405527881984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480017.610735:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527881984:0@lo:400:kworker.0 00010000:00080000:0.0:1789480017.610745:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987daa680 x1876405527882496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480017.610753:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527882496:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.611621:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.611666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527881856:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.611694:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.611714:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527882368:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.611734:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480017.611896:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527881216:0@lo:400:kworker.0 00010000:00080000:1.0:1789480017.611912:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da8380 x1876405527881728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480017.611923:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527881728:0@lo:400:kworker.0 00010000:00080000:1.0:1789480017.611940:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9f80 x1876405527882240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480017.611948:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527882240:0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.612211:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881856 00000100:00100000:1.0:1789480017.612217:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881856 00000100:00100000:1.0:1789480017.612263:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882368 00000100:00100000:1.0:1789480017.612266:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882368 00000100:00100000:1.0:1789480017.612290:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789480017.612368:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527881856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.612486:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527881856:12345-0@lo:400:kworker.0 Request processed in 189us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.612493:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789480017.612508:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789480017.612529:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527882368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480017.612558:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527882368:12345-0@lo:400:kworker.0 Request processed in 44us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480017.612564:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1789480017.612588:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480017.612592:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480017.612614:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da8e00 x1876405527881856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480017.612625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527881856:0@lo:400:kworker.0 00010000:00080000:1.0:1789480017.612638:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9880 x1876405527882368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480017.612664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527882368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.614165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527881344 00000100:00100000:0.0:1789480017.614183:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527881344 00000100:00100000:0.0:1789480017.614673:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789480017.614687:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480017.614810:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527881344:12345-0@lo:400:kworker.0 Request processed in 126us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480017.614818:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789480017.617494:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527881344:0@lo:400:kworker.0 00000100:00100000:1.0:1789480018.117497:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527882752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480018.117573:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480018.118575:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882752 00000100:00100000:2.0:1789480018.118584:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882752 00000100:00100000:2.0:1789480018.118628:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789480018.118636:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527882752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480018.118664:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480018.118728:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527882752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480018.118735:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1789480018.118931:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d28a80 x1876405527882752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480018.118949:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527882752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480018.118964:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480018.118978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480018.119016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480018.119622:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527882880 00000100:00100000:3.0:1789480018.119628:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527882880 00000100:00100000:3.0:1789480018.119668:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789480018.119677:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527882880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480018.119689:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480018.119735:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527882880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480018.119741:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789480018.120080:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd180 x1876405527882880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480018.120095:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527882880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789480018.246101:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480019.269741:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480019.290046:0:13045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789480020.165706:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480020.165728:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527883008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480020.165789:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480020.166102:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527883136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480020.166152:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480020.166299:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883008 00000100:00100000:3.0:1789480020.166306:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883008 00000100:00100000:3.0:1789480020.166367:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883136 00000100:00100000:3.0:1789480020.166371:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883136 00000100:00100000:3.0:1789480020.166390:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789480020.166398:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527883008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480020.166424:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480020.166482:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527883008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480020.166489:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789480020.166736:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789480020.166776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbc000 x1876405527883008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480020.166794:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527883008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480020.166856:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789480020.166864:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527883136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480020.166875:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480020.166917:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527883136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480020.166933:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1789480020.167511:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987cbd180 x1876405527883136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480020.167527:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527883136:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789480020.294068:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480020.682401:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480020.682420:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527883264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480020.682482:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480020.682608:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883264 00000100:00100000:0.0:1789480020.682617:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883264 00000100:00100000:0.0:1789480020.682670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789480020.682680:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527883264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480020.682709:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789480020.682757:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527883264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480020.682764:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480020.682863:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527883264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480020.831948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480020.831990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480020.832019:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480020.832042:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480020.832065:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480020.832089:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870208 00000100:00100000:0.0:1789480020.832098:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870208 00000100:00100000:0.0:1789480020.832159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870464 00000100:00100000:0.0:1789480020.832163:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870464 00000100:00100000:0.0:1789480020.832179:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870080 00000100:00100000:0.0:1789480020.832181:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870080 00000100:00100000:0.0:1789480020.832215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870336 00000100:00100000:0.0:1789480020.832218:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870336 00000100:00100000:0.0:1789480020.832234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:0.0:1789480020.832243:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507870208:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480020.832538:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507870208:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 295us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480020.832546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:0.0:1789480020.832565:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:0.0:1789480020.832572:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507870464:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480020.832597:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507870464:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480020.832603:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:0.0:1789480020.832613:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00100000:0.0:1789480020.832619:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507870080:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480020.832638:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507870080:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480020.832644:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00100000:0.0:1789480020.832653:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00100000:0.0:1789480020.832659:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507870336:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480020.832678:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507870336:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480020.832684:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00080000:2.0:1789480020.833289:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480020.833295:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480020.834528:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507869952 00000100:00100000:3.0:1789480020.834540:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507869952 00000100:00100000:3.0:1789480020.834595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 322 00000100:00100000:3.0:1789480020.834604:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507869952:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480020.834663:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507869952:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 59us (2722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480020.834670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 322 00010000:00010000:1.0:1789480021.319556:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480022.347526:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480022.724794:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527883392:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.724861:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.724908:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527883904:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.724932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.724950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527884416:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.724971:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.724987:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527884928:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725009:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725046:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789480022.725051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527883776:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725076:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725094:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527884288:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725113:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725128:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527884800:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725146:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725174:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527883520:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725213:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725230:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527884032:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725250:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725279:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527884544:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725297:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725316:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789480022.725321:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527883648:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725355:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527884160:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725390:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725553:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527884672:0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480022.725603:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883392 00000100:00100000:1.0:1789480022.725610:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883392 00000100:00100000:1.0:1789480022.725648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789480022.725656:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527883392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725702:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527883392:12345-0@lo:400:kworker.0 Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.725709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789480022.725741:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883904 00000100:00100000:1.0:1789480022.725745:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883904 00000100:00100000:1.0:1789480022.725769:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883648 00000100:00100000:1.0:1789480022.725772:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883648 00000100:00100000:1.0:1789480022.725786:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789480022.725792:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527883904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725823:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527883904:12345-0@lo:400:kworker.0 Request processed in 31us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.725829:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789480022.725839:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789480022.725844:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527883648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.725873:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527883648:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.725879:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789480022.725902:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884416 00000100:00100000:1.0:1789480022.725906:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884416 00000100:00100000:1.0:1789480022.725932:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884928 00000100:00100000:1.0:1789480022.725934:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884928 00000100:00100000:1.0:1789480022.725946:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884288 00000100:00100000:1.0:1789480022.725948:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884288 00000100:00100000:1.0:1789480022.725957:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884800 00000100:00100000:1.0:1789480022.725960:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884800 00000100:00100000:1.0:1789480022.725973:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480022.725979:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527884416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.726010:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527884416:12345-0@lo:400:kworker.0 Request processed in 31us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.726016:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480022.726027:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789480022.726032:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527884928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.726058:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527884928:12345-0@lo:400:kworker.0 Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.726063:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789480022.726074:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789480022.726079:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527884288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.726103:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527884288:12345-0@lo:400:kworker.0 Request processed in 24us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.726108:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789480022.726118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789480022.726123:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527884800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.726147:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527884800:12345-0@lo:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.726162:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789480022.726185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883776 00000100:00100000:1.0:1789480022.726211:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883776 00000100:00100000:1.0:1789480022.726230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527883520 00000100:00100000:1.0:1789480022.726233:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527883520 00000100:00100000:1.0:1789480022.726242:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884032 00000100:00100000:1.0:1789480022.726245:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884032 00000100:00100000:3.0:1789480022.731513:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884544 00000100:00100000:3.0:1789480022.731526:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884544 00000100:00100000:3.0:1789480022.731568:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884160 00000100:00100000:3.0:1789480022.731572:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884160 00000100:00100000:3.0:1789480022.731584:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527884672 00000100:00100000:3.0:1789480022.731587:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527884672 00000100:00100000:3.0:1789480022.731602:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789480022.731611:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527883776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.731691:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527883776:12345-0@lo:400:kworker.0 Request processed in 81us (6614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.731699:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789480022.731716:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789480022.731723:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527883520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.731764:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527883520:12345-0@lo:400:kworker.0 Request processed in 41us (6549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.731770:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789480022.731784:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789480022.731789:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527884544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.731818:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527884544:12345-0@lo:400:kworker.0 Request processed in 29us (6519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.731824:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789480022.731836:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789480022.731842:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527884160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.731868:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527884160:12345-0@lo:400:kworker.0 Request processed in 27us (6476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.731873:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789480022.731884:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789480022.731888:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527884672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.731910:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527884672:12345-0@lo:400:kworker.0 Request processed in 22us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.731916:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789480022.732023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527883776:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.732041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4ded80 x1876405527884288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.732050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527884288:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.732061:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df800 x1876405527884800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.732081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527884800:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.732094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527883392:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.732105:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527883904:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.732114:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dca80 x1876405527884416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.732121:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527884416:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.732130:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df100 x1876405527884928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.732137:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527884928:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.732185:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527883648:0@lo:400:kworker.0 00000100:00080000:0.0:1789480022.739258:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480022.739266:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480022.739269:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480022.739271:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789480022.743295:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f5880 x1876405527884160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.743313:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527884160:0@lo:400:kworker.0 00010000:00080000:3.0:1789480022.743329:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dc000 x1876405527884672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480022.743338:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527884672:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.743353:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527883520:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.743367:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527884544:0@lo:400:kworker.0 00000100:00100000:3.0:1789480022.743427:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527885056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480022.743501:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480022.743580:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885056 00000100:00100000:3.0:1789480022.743587:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885056 00000100:00100000:3.0:1789480022.743630:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789480022.743641:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527885056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480022.743673:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789480022.743722:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527885056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480022.743729:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789480022.744940:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527885056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480022.751291:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789480022.751310:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527884032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480022.751737:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527884032:12345-0@lo:400:kworker.0 Request processed in 432us (26483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480022.751746:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789480022.761651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527884032:0@lo:400:kworker.0 00000100:00100000:1.0:1789480023.236712:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527885312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480023.236772:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480023.236889:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885312 00000100:00100000:2.0:1789480023.236897:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885312 00000100:00100000:2.0:1789480023.236955:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789480023.236965:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527885312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480023.236991:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480023.237038:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527885312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480023.237044:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1789480023.237081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da8e00 x1876405527885312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480023.237099:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527885312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480023.237262:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480023.237283:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527885184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480023.237310:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480023.237430:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885184 00000100:00100000:1.0:1789480023.237435:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885184 00000100:00100000:1.0:1789480023.237465:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789480023.237472:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527885184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480023.237482:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480023.237522:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527885184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480023.237528:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:0.0:1789480023.237645:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69810b1180 x1876405527885184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480023.237657:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527885184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789480023.364363:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789480024.192974:0:13194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc80be2ca0 20000000:00000080:1.0:1789480024.192991:0:13194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6987c98800 uarg=0000000000000000 20000000:01000000:1.0:1789480024.193035:0:13194:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789480024.193041:0:13194:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789480024.193045:0:13194:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789480024.194678:0:13195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1789480024.194816:0:13194:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789480024.208022:0:13194:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789480024.208050:0:13194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208142:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208154:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208161:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208167:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d306 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208173:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d314 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208409:0:13194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208415:0:13194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208455:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208468:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 12 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.208491:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885440:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480024.208663:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.208677:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 23 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.208687:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885568:0@lo:104: 00000100:00100000:3.0:1789480024.213509:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480024.213612:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.213626:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 23 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.213640:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885696:0@lo:104: 00000100:00100000:3.0:1789480024.213700:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480024.213725:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.213733:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 23 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.213740:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885824:0@lo:104: 00000100:00100000:3.0:1789480024.213760:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480024.213791:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.213799:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 23 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.213807:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885952:0@lo:104: 00000100:00100000:3.0:1789480024.213826:0:13194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480024.213846:0:13194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.213854:0:13194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.213863:0:13194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527886080:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480024.213989:0:13194:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b57000 going to sleep for 11 seconds 00000100:00100000:1.0:1789480024.214711:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885568 00000100:00100000:1.0:1789480024.214720:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885568 00000100:00100000:1.0:1789480024.214755:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885696 00000100:00100000:1.0:1789480024.214759:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885696 00000100:00100000:1.0:1789480024.214769:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885824 00000100:00100000:1.0:1789480024.214772:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885824 00000100:00100000:1.0:1789480024.214780:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527885952 00000100:00100000:1.0:1789480024.214783:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527885952 00000100:00100000:1.0:1789480024.214795:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789480024.214803:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+6:13194:x1876405527885568:12345-0@lo:104: 00010000:00010000:1.0:1789480024.214816:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.214887:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480024.214894:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+6:13194:x1876405527885568:12345-0@lo:104: Request processed in 92us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.214901:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789480024.214917:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789480024.214922:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+5:13194:x1876405527885696:12345-0@lo:104: 00010000:00010000:1.0:1789480024.214929:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.214960:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789480024.214965:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+5:13194:x1876405527885696:12345-0@lo:104: Request processed in 44us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.214971:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789480024.214981:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480024.214986:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:13194:x1876405527885824:12345-0@lo:104: 00010000:00010000:1.0:1789480024.215004:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215041:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789480024.215046:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:13194:x1876405527885824:12345-0@lo:104: Request processed in 60us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.215052:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480024.215063:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789480024.215068:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13194:x1876405527885952:12345-0@lo:104: 00010000:00010000:1.0:1789480024.215075:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215101:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789480024.215105:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13194:x1876405527885952:12345-0@lo:104: Request processed in 37us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.215110:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789480024.215125:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789480024.215130:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215137:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbc00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480024.215141:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215150:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480024.215157:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480024.215169:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480024.215218:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215225:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480024.215251:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215258:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbc00/0xdaa289fda243d314 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d31b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215270:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789480024.215273:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215279:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480024.215282:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215289:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480024.215295:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480024.215300:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480024.215313:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215318:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480024.215339:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215346:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243d306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d30d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215356:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480024.215359:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215365:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480024.215368:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215374:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480024.215381:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480024.215386:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480024.215397:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215403:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480024.215409:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215414:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243d2f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2ff expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215420:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480024.215429:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215435:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480024.215437:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215444:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480024.215450:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480024.215456:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480024.215471:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215476:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480024.215492:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215498:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7000/0xdaa289fda243d2ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d2f1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.215510:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480024.215512:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480024.215514:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480024.215520:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480024.215539:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527886208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480024.215744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480024.215758:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527886592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480024.215782:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885568:0@lo:104: 00000100:00100000:3.0:1789480024.215796:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885696:0@lo:104: 00000100:00100000:3.0:1789480024.215809:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885824:0@lo:104: 00000100:00100000:3.0:1789480024.215817:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885952:0@lo:104: 00000100:00100000:1.0:1789480024.217395:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480024.217477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527886464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480024.217539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480024.217556:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480024.217563:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527886336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480024.217799:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480024.217842:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886208 00000100:00100000:1.0:1789480024.217852:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886208 00010000:00010000:1.0:1789480024.217883:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 24 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480024.217906:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886464 00000100:00100000:1.0:1789480024.217909:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886464 00010000:00010000:1.0:1789480024.217920:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 25 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480024.217929:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886336 00000100:00100000:1.0:1789480024.217931:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886336 00010000:00010000:1.0:1789480024.217941:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480024.217954:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789480024.217962:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+26:3648:x1876405527886208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480024.217974:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789480024.217981:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1789480024.217982:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480024.217995:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+26:3646:x1876405527886464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480024.217997:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480024.218008:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480024.218015:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.218018:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243d31b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d314 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480024.218034:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 26 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480024.218054:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d2ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d2f8 expref: 25 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.218058:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480024.218067:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480024.218100:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527886208:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.218109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480024.218124:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+23:3646:x1876405527886464:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.218130:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789480024.218136:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480024.218142:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+23:3646:x1876405527886336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480024.218151:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480024.218157:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 22 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.218167:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 22 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480024.218176:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527886464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480024.218180:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7400/0xdaa289fda243d30d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d306 expref: 22 pid: 6514 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.218218:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480024.218250:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+21:3646:x1876405527886336:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480024.218256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480024.218281:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527886208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480024.218424:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527886336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480024.218755:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480024.219005:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480024.219082:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527885440:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480024.219130:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886592 00000100:00100000:1.0:1789480024.219135:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886592 00010000:00010000:1.0:1789480024.219153:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480024.219253:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870592 00000100:00100000:1.0:1789480024.219265:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870592 00010000:00010000:1.0:1789480024.219281:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480024.221659:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789480024.221674:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+21:3647:x1876405527886592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480024.221691:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480024.221700:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221715:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221729:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d2f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d2ea expref: 21 pid: 6515 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221744:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480024.221820:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a679393-20ef-489d-b204-2797ec519e97+20:3647:x1876405527886592:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480024.221826:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789480024.221867:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1789480024.221874:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507870592:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480024.221883:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480024.221888:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221898:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221908:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bd800/0xdaa289fda243d330 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a22 expref: 13 pid: 6515 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.221928:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480024.221965:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2401:x1876405507870592:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 92us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480024.221970:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1789480024.222012:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527886592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480024.222152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480024.222185:0:13194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13194:1876405527886080:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480024.222236:0:13194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480024.222630:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870720 00000100:00100000:0.0:1789480024.222636:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870720 00010000:00010000:0.0:1789480024.222660:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480024.222684:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:0.0:1789480024.222690:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2402:x1876405507870720:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480024.222698:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480024.222703:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222711:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222721:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487200/0xdaa289fda243d2e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29e3 expref: 12 pid: 6512 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222734:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222741:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222775:0:9525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222783:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222789:0:9525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222795:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222801:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480024.222804:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222812:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222822:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480024.222830:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480024.222858:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:2402:x1876405507870720:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 168us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480024.222865:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00010000:00010000:3.0:1789480024.225710:0:13194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.225727:0:13194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480024.225734:0:13194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7200/0xdaa289fda243d353 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480024.388407:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480025.284819:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480025.284853:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527886720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480025.284915:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.285224:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886720 00000100:00100000:3.0:1789480025.285243:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886720 00000100:00100000:3.0:1789480025.285298:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789480025.285308:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527886720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480025.285336:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480025.285400:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527886720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.285415:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789480025.285915:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789480025.285947:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f6300 x1876405527886720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480025.285968:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527886720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480025.286383:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480025.286395:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527886848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480025.286435:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.286691:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886848 00000100:00100000:3.0:1789480025.286697:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886848 00000100:00100000:3.0:1789480025.286752:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789480025.286760:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527886848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480025.286776:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480025.286815:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527886848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.286822:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789480025.287681:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789480025.287716:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb504000 x1876405527886848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480025.287735:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527886848:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1789480025.348284:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480025.348291:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8800 from 7 10000000:01000000:1.0:1789480025.348303:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480025.348345:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.348357:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.348368:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480025.348390:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527886976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.348455:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.348527:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480025.349101:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527886976 00000100:00100000:0.0:1789480025.349110:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527886976 00000100:00100000:0.0:1789480025.349160:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789480025.349169:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527886976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480025.349183:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480025.349224:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d35a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480025.349247:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d35a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480025.349259:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d35a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480025.349268:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db200, rc 0) 00000100:00100000:0.0:1789480025.349449:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527886976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 280us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480025.349456:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789480025.356028:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527886976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480025.356058:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.356070:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480025.356159:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.356237:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.356392:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b57000 going to sleep for 11 seconds 00000100:00100000:0.0:1789480025.356433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887104 00000100:00100000:0.0:1789480025.356440:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887104 00000100:00100000:0.0:1789480025.356932:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789480025.356944:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527887104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480025.357132:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527887104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480025.357149:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1789480025.357657:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.359427:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.359523:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.359566:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b57000 going to sleep for 11 seconds 00000100:00100000:1.0:1789480025.359966:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887232 00000100:00100000:1.0:1789480025.359973:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887232 00000100:00100000:1.0:1789480025.360016:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789480025.360024:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527887232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.360133:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527887232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.360141:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789480025.360419:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480025.363596:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789480025.364979:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789480025.365011:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480025.365022:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.365046:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480025.365057:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480025.365060:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8000 from 7 10000000:01000000:1.0:1789480025.365062:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480025.365111:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.365119:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.365129:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480025.365152:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.366486:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.366535:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480025.366859:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887360 00000100:00100000:2.0:1789480025.366876:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887360 00000100:00100000:2.0:1789480025.366932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789480025.366942:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527887360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480025.366955:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480025.366971:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d368 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.366995:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d368 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.367005:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d368 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.367014:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047bc00, rc 0) 00000100:00100000:2.0:1789480025.367077:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.367083:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789480025.367489:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480025.367505:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.367525:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480025.367595:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.367627:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.367654:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b57600 going to sleep for 11 seconds 00000100:00100000:1.0:1789480025.367773:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887488 00000100:00100000:1.0:1789480025.367779:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887488 00000100:00100000:1.0:1789480025.367806:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789480025.367814:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.367977:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.367984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789480025.368400:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.368433:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.368471:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.368503:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b57600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480025.368566:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887616 00000100:00100000:2.0:1789480025.368571:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887616 00000100:00100000:2.0:1789480025.368593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789480025.368601:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480025.368761:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.368768:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789480025.369353:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480025.372005:0:13209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789480025.374613:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789480025.374648:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480025.374659:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.374695:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480025.374819:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480025.374823:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a866ce000 from 7 10000000:01000000:3.0:1789480025.374826:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480025.374872:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.374881:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.374891:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480025.374924:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.374981:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.375023:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480025.375355:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887744 00000100:00100000:2.0:1789480025.375363:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887744 00000100:00100000:2.0:1789480025.375407:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1789480025.375416:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527887744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480025.375428:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480025.375440:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d376 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.375464:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d376 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.375487:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d376 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480025.375495:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789480025.375553:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527887744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.375560:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789480025.375712:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480025.375726:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.375742:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480025.375807:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.375834:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.375989:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480025.376165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527887872 00000100:00100000:2.0:1789480025.376170:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527887872 00000100:00100000:2.0:1789480025.376227:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789480025.376246:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527887872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480025.376354:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527887872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.376370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789480025.376609:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527887872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.376641:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.376695:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.376724:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480025.376827:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888000 00000100:00100000:3.0:1789480025.376832:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888000 00000100:00100000:3.0:1789480025.376873:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1789480025.376880:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527888000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.376958:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527888000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.376964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789480025.377174:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480025.381825:0:13210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789480025.382494:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789480025.382582:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480025.382595:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.382608:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480025.382619:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480025.382621:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a83cfb000 from 7 10000000:01000000:1.0:1789480025.382624:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480025.382659:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.382814:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.382837:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480025.382926:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.382992:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.383035:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480025.383346:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888128 00000100:00100000:3.0:1789480025.383354:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888128 00000100:00100000:3.0:1789480025.383400:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1789480025.383409:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527888128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480025.383424:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480025.383438:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d384 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.383461:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d384 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.383470:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d384 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.383490:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6800, rc 0) 00000100:00100000:3.0:1789480025.384037:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527888128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 626us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.384053:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789480025.396135:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480025.396165:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.396177:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480025.396373:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.396428:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480025.396754:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480025.396809:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888256 00000100:00100000:3.0:1789480025.396816:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888256 00000100:00100000:3.0:1789480025.397058:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1789480025.397069:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527888256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.397429:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527888256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.397437:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789480025.398403:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480025.398457:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480025.398619:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480025.399520:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480025.399817:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888384 00000100:00100000:3.0:1789480025.399825:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888384 00000100:00100000:3.0:1789480025.400029:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1789480025.400040:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527888384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480025.400179:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527888384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.400222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789480025.400319:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527888384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789480025.411395:0:13212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789480025.411580:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789480025.411603:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480025.411613:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.411625:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.416417:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480025.572667:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480025.573009:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870848 00000100:00100000:3.0:1789480025.573019:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870848 00000100:00100000:3.0:1789480025.573066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 336 00000100:00100000:3.0:1789480025.573084:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:6182:x1876405507870848:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480025.573099:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480025.573116:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a53 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.573152:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.573164:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480025.573172:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6e00, rc 0) 00000100:00100000:3.0:1789480025.573424:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507870848:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 340us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.573432:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 336 00000100:00100000:3.0:1789480025.583151:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480025.591401:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507870976 00000100:00100000:1.0:1789480025.591414:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507870976 00000100:00100000:1.0:1789480025.591682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 337 00000100:00100000:1.0:1789480025.591694:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507870976:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.592084:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507870976:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 390us (8952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.592092:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 337 00000100:00100000:3.0:1789480025.610150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480025.615626:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871104 00000100:00100000:1.0:1789480025.615641:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871104 00000100:00100000:1.0:1789480025.615722:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 338 00000100:00100000:1.0:1789480025.615733:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507871104:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.616691:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507871104:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 955us (6544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.616701:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 338 00000100:00100000:2.0:1789480025.632496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480025.632632:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871232 00000100:00100000:1.0:1789480025.632642:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871232 00000100:00100000:1.0:1789480025.632697:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 339 00000100:00100000:1.0:1789480025.632707:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507871232:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480025.632722:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480025.632740:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a5a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.632782:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.632793:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480025.632801:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc600, rc 0) 00000100:00100000:1.0:1789480025.632871:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507871232:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 165us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.632878:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 339 00000100:00100000:1.0:1789480025.640123:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480025.640160:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871360 00000100:00100000:1.0:1789480025.640168:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871360 00000100:00100000:1.0:1789480025.640231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00100000:1.0:1789480025.640242:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507871360:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480025.640397:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507871360:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 156us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480025.640404:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00100000:1.0:1789480025.645707:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480025.649171:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871488 00000100:00100000:0.0:1789480025.649184:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871488 00000100:00100000:0.0:1789480025.649272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 341 00000100:00100000:0.0:1789480025.649282:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507871488:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480025.649432:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507871488:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 151us (3733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480025.649440:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 341 00000100:00100000:0.0:1789480025.816562:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480025.816584:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527888512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480025.816648:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480025.817598:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888512 00000100:00100000:3.0:1789480025.817609:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888512 00000100:00100000:3.0:1789480025.818559:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789480025.818573:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527888512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480025.818609:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480025.818678:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527888512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480025.818685:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789480025.818783:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527888512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480025.940673:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480025.940710:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480025.940735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480025.940756:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480025.940787:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871616 00000100:00100000:2.0:1789480025.940796:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871616 00000100:00100000:2.0:1789480025.940868:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871872 00000100:00100000:2.0:1789480025.940872:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871872 00000100:00100000:2.0:1789480025.940886:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507871744 00000100:00100000:2.0:1789480025.940889:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507871744 00000100:00100000:2.0:1789480025.940899:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872000 00000100:00100000:2.0:1789480025.940902:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872000 00000100:00100000:2.0:1789480025.940915:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:2.0:1789480025.940923:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507871616:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480025.941005:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507871616:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 82us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.941013:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:2.0:1789480025.941030:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 225 00000100:00100000:2.0:1789480025.941049:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507871872:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480025.941078:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507871872:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.941084:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 225 00000100:00100000:2.0:1789480025.941097:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:2.0:1789480025.941104:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507871744:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480025.941139:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507871744:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.941145:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:2.0:1789480025.941158:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00100000:2.0:1789480025.941164:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507872000:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480025.941185:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507872000:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480025.941219:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00080000:2.0:1789480025.941248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480025.941252:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480026.441421:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480027.473816:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480027.844859:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527888768:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.844923:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845055:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527889280:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845077:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527889792:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845119:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845142:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789480027.845148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527888640:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845227:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527889152:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845279:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527889664:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845301:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845316:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527890176:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845332:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845352:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527888896:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845369:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845396:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527889408:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845641:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845669:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527889920:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845691:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845710:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789480027.845717:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527889024:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845746:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845761:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527889536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.845782:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.845905:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890048:0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846049:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888768 00000100:00100000:3.0:1789480027.846057:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888768 00000100:00100000:3.0:1789480027.846089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889280 00000100:00100000:3.0:1789480027.846098:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889280 00000100:00100000:3.0:1789480027.846126:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889792 00000100:00100000:3.0:1789480027.846129:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889792 00000100:00100000:3.0:1789480027.846141:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889408 00000100:00100000:3.0:1789480027.846144:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889408 00000100:00100000:3.0:1789480027.846157:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889920 00000100:00100000:3.0:1789480027.846159:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889920 00000100:00100000:3.0:1789480027.846170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889024 00000100:00100000:3.0:1789480027.846172:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889024 00000100:00100000:3.0:1789480027.846186:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789480027.846213:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527888768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846278:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527888768:12345-0@lo:400:kworker.0 Request processed in 65us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.846285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789480027.846303:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789480027.846309:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527889280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846338:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527889280:12345-0@lo:400:kworker.0 Request processed in 30us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.846344:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789480027.846356:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789480027.846362:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527889792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846388:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527889792:12345-0@lo:400:kworker.0 Request processed in 27us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.846393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789480027.846417:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789480027.846424:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527889408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846473:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527889408:12345-0@lo:400:kworker.0 Request processed in 38us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.846485:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789480027.846498:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789480027.846503:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527889920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.846529:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527889920:12345-0@lo:400:kworker.0 Request processed in 27us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.846533:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789480027.846541:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789480027.846546:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527889024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.846768:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789480027.846804:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698769bb80 x1876405527889408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480027.846817:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527889408:0@lo:400:kworker.0 00010000:00080000:1.0:1789480027.846828:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698769b800 x1876405527889920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480027.846836:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527889920:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.846873:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888640 00000100:00100000:1.0:1789480027.846877:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888640 00000100:00100000:1.0:1789480027.846908:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789480027.846914:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527888640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847024:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527889024:12345-0@lo:400:kworker.0 Request processed in 476us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789480027.847055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889152 00000100:00100000:3.0:1789480027.847059:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889152 00000100:00100000:3.0:1789480027.847078:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527888896 00000100:00100000:3.0:1789480027.847080:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527888896 00000100:00100000:3.0:1789480027.847091:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789480027.847097:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527889152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847127:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527889152:12345-0@lo:400:kworker.0 Request processed in 30us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847132:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789480027.847143:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789480027.847148:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527888896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847175:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527888896:12345-0@lo:400:kworker.0 Request processed in 27us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847180:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789480027.847217:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889664 00000100:00100000:3.0:1789480027.847221:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889664 00000100:00100000:3.0:1789480027.847236:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890176 00000100:00100000:3.0:1789480027.847238:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890176 00000100:00100000:3.0:1789480027.847247:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527889536 00000100:00100000:3.0:1789480027.847250:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527889536 00000100:00100000:3.0:1789480027.847274:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890048 00000100:00100000:3.0:1789480027.847277:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890048 00000100:00100000:3.0:1789480027.847289:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480027.847295:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527889664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847325:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527889664:12345-0@lo:400:kworker.0 Request processed in 30us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847330:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480027.847340:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789480027.847346:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527890176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847374:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527890176:12345-0@lo:400:kworker.0 Request processed in 28us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847379:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789480027.847390:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789480027.847395:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527889536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847633:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527889536:12345-0@lo:400:kworker.0 Request processed in 237us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847641:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789480027.847654:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789480027.847661:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847689:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890048:12345-0@lo:400:kworker.0 Request processed in 29us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480027.847705:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789480027.847724:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480027.847729:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480027.847732:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480027.847735:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480027.847767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527889152:0@lo:400:kworker.0 00010000:00080000:3.0:1789480027.847781:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698769b480 x1876405527889664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480027.847791:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527889664:0@lo:400:kworker.0 00010000:00080000:3.0:1789480027.847801:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698769ad80 x1876405527890176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480027.847809:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527890176:0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847820:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527888768:0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847831:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527889280:0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.847842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527889792:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.848080:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527888640:12345-0@lo:400:kworker.0 Request processed in 1164us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480027.848087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789480027.848147:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527889024:0@lo:400:kworker.0 00010000:00080000:1.0:1789480027.848158:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987698700 x1876405527889536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480027.848175:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527889536:0@lo:400:kworker.0 00010000:00080000:1.0:1789480027.848188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698769a680 x1876405527890048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480027.848209:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890048:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.848220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527888896:0@lo:400:kworker.0 00000100:00100000:3.0:1789480027.848554:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527888640:0@lo:400:kworker.0 00000100:00100000:1.0:1789480027.849094:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480027.849105:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527890304:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480027.849145:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480027.849205:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890304 00000100:00100000:1.0:1789480027.849212:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890304 00000100:00100000:1.0:1789480027.849248:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789480027.849266:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527890304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480027.849294:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789480027.849331:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527890304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480027.849337:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789480027.849390:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527890304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480028.356316:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480028.356338:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527890432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480028.356397:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480028.356481:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890432 00000100:00100000:0.0:1789480028.356489:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890432 00000100:00100000:0.0:1789480028.356532:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789480028.356540:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527890432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480028.356568:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480028.356622:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527890432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480028.356629:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789480028.356727:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866faa00 x1876405527890432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480028.356759:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527890432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480028.357015:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480028.357024:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480028.357052:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480028.357082:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890560 00000100:00100000:2.0:1789480028.357086:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890560 00000100:00100000:2.0:1789480028.357109:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789480028.357116:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480028.357140:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480028.357174:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480028.357180:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1789480028.357219:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9c00 x1876405527890560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480028.357232:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890560:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789480028.486148:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480029.464072:0:13392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789480029.515917:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480030.405663:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480030.405685:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527890688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480030.405746:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480030.406118:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890688 00000100:00100000:3.0:1789480030.406126:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890688 00000100:00100000:3.0:1789480030.406232:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480030.406247:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527890688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480030.406274:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1789480030.406542:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480030.406899:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527890688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 659us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480030.406908:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789480030.409792:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480030.409819:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527890816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480030.409901:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480030.410002:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890816 00000100:00100000:3.0:1789480030.410009:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890816 00000100:00100000:3.0:1789480030.410074:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789480030.410083:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527890816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480030.410105:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480030.410150:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527890816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480030.410156:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1789480030.410205:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6988807b80 x1876405527890816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480030.410404:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480030.410519:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988807b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527890816:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789480030.411640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f4a80 x1876405527890688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480030.411659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527890688:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789480030.532542:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480030.917372:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480030.917440:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480030.917538:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527890944 00000100:00100000:3.0:1789480030.917545:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527890944 00000100:00100000:3.0:1789480030.917590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789480030.917598:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480030.917630:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480030.917672:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527890944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480030.917678:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789480030.917721:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527890944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480031.060029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480031.060092:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480031.060119:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480031.060149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480031.060178:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480031.060258:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872256 00000100:00100000:0.0:1789480031.060267:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872256 00000100:00100000:0.0:1789480031.060328:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872512 00000100:00100000:0.0:1789480031.060332:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872512 00000100:00100000:0.0:1789480031.060351:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872384 00000100:00100000:0.0:1789480031.060355:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872384 00000100:00100000:2.0:1789480031.060374:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872640 00000100:00100000:2.0:1789480031.060381:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872640 00000100:00100000:0.0:1789480031.060382:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:0.0:1789480031.060396:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507872256:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480031.060416:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:2.0:1789480031.060425:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507872512:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480031.060474:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507872256:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 81us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480031.060476:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507872512:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 51us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480031.060489:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:2.0:1789480031.061045:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:2.0:1789480031.061064:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:2.0:1789480031.061072:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507872384:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480031.061104:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507872384:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480031.061119:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:2.0:1789480031.061133:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:2.0:1789480031.061139:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507872640:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480031.061163:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507872640:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480031.061168:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:2.0:1789480031.061387:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872128 00000100:00100000:2.0:1789480031.061393:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872128 00000100:00100000:2.0:1789480031.061422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 343 00000100:00100000:2.0:1789480031.061429:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507872128:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480031.061467:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507872128:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480031.061474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 343 00000100:00080000:2.0:1789480031.061978:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480031.061984:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480031.565155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480032.581648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480032.964611:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480032.964632:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527891072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480032.964708:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480032.964812:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891072 00000100:00100000:1.0:1789480032.964821:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891072 00000100:00100000:1.0:1789480032.964876:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789480032.964888:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527891072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480032.964918:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789480032.964994:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527891072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.965000:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789480032.965757:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527891072:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480032.971354:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527891584:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971430:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480032.971517:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527892096:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971550:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480032.971564:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891584 00000100:00100000:3.0:1789480032.971576:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891584 00000100:00100000:3.0:1789480032.971637:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789480032.971648:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527891584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.971735:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527891584:12345-0@lo:400:kworker.0 Request processed in 88us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.971743:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789480032.971785:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892096 00000100:00100000:3.0:1789480032.971789:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892096 00000100:00100000:2.0:1789480032.971797:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527892608:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480032.971849:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892608 00000100:00100000:3.0:1789480032.971854:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892608 00000100:00100000:2.0:1789480032.971895:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527891584:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971926:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789480032.971932:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527891456:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971956:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480032.971975:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527891968:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.971992:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480032.972002:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789480032.972004:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527892480:0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.972023:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527892096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.972046:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480032.972121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527891200:0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.972602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527891328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.976713:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527892096:12345-0@lo:400:kworker.0 Request processed in 4684us (5150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.976731:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1789480032.976996:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4dea00 x1876405527892096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480032.977015:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527892096:0@lo:400:kworker.0 00000100:00080000:2.0:1789480032.977061:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480032.977067:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480032.977106:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891968 00000100:00100000:2.0:1789480032.977112:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891968 00000100:00100000:2.0:1789480032.977154:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892480 00000100:00100000:2.0:1789480032.977156:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892480 00000100:00100000:2.0:1789480032.977169:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789480032.977176:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527892608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.977284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480032.977425:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527891712:0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.978046:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789480032.978066:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527891968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.978111:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480032.978144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527892224:0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.978169:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480032.978277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891200 00000100:00100000:1.0:1789480032.978285:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891200 00000100:00100000:3.0:1789480032.978328:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527891968:12345-0@lo:400:kworker.0 Request processed in 269us (6332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.978337:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789480032.978346:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789480032.978352:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527891200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.978375:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789480032.978385:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527892480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.978409:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527891200:12345-0@lo:400:kworker.0 Request processed in 59us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.978420:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789480032.978458:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527892480:12345-0@lo:400:kworker.0 Request processed in 74us (6414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.978467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789480032.978502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891456 00000100:00100000:3.0:1789480032.978509:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891456 00000100:00100000:3.0:1789480032.978544:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789480032.978549:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527891456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480032.978583:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527891456:12345-0@lo:400:kworker.0 Request processed in 34us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480032.978589:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789480032.979676:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527892608:12345-0@lo:400:kworker.0 Request processed in 2491us (7829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480032.979691:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:2.0:1789480032.979803:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480032.979809:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480032.979929:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527891456:0@lo:400:kworker.0 00010000:00080000:2.0:1789480032.979945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df100 x1876405527891968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480032.979972:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527891968:0@lo:400:kworker.0 00010000:00080000:2.0:1789480032.979986:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02e300 x1876405527892480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480032.979994:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527892480:0@lo:400:kworker.0 00010000:00080000:2.0:1789480032.980005:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02c380 x1876405527892608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480032.980013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527892608:0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.980371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527891200:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.980447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480032.980630:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527891840:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.980676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480032.980709:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891712 00000100:00100000:1.0:1789480032.980779:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891712 00000100:00100000:1.0:1789480032.980833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789480032.980843:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527891712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.980896:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527891712:12345-0@lo:400:kworker.0 Request processed in 55us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.980902:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789480032.980916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892224 00000100:00100000:1.0:1789480032.980919:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892224 00000100:00100000:1.0:1789480032.980940:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891328 00000100:00100000:1.0:1789480032.980943:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891328 00000100:00100000:1.0:1789480032.980955:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789480032.980960:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527892224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.980987:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527892224:12345-0@lo:400:kworker.0 Request processed in 27us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.980992:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789480032.981012:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789480032.981018:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527891328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.981044:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527891328:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480032.981049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:1.0:1789480032.981064:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480032.981096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527891712:0@lo:400:kworker.0 00000100:00100000:1.0:1789480032.981106:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527892224:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.981398:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527892352:0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.981433:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480032.981592:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527891328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.981644:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527891840 00000100:00100000:0.0:1789480032.981648:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527891840 00000100:00100000:0.0:1789480032.981800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892352 00000100:00100000:0.0:1789480032.981804:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892352 00000100:00080000:2.0:1789480032.981837:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480032.981970:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789480032.981980:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527891840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480032.982020:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527891840:12345-0@lo:400:kworker.0 Request processed in 43us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480032.982026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:2.0:1789480032.982054:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb4df800 x1876405527891840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480032.982065:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527891840:0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.982381:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789480032.982388:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527892352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480032.982428:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527892352:12345-0@lo:400:kworker.0 Request processed in 40us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480032.982445:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00080000:0.0:1789480032.982475:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb02e680 x1876405527892352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480032.982484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527892352:0@lo:400:kworker.0 00000100:00100000:3.0:1789480033.476475:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480033.476497:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527892736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480033.476559:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480033.478839:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892736 00000100:00100000:2.0:1789480033.478854:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892736 00000100:00100000:2.0:1789480033.478913:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789480033.478924:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527892736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480033.478954:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480033.479028:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527892736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480033.479035:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1789480033.479081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0dc00 x1876405527892736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480033.479103:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527892736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480033.484278:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480033.484301:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527892864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480033.484364:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480033.484415:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892864 00000100:00100000:1.0:1789480033.484423:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892864 00000100:00100000:1.0:1789480033.484477:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789480033.484485:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527892864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480033.484505:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480033.484544:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527892864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480033.484550:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789480033.484585:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6988805880 x1876405527892864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480033.484602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527892864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789480033.608445:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480034.628417:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480035.524453:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527892992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480035.524534:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.524640:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527892992 00000100:00100000:1.0:1789480035.524653:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527892992 00000100:00100000:1.0:1789480035.524710:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789480035.524719:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527892992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480035.524748:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480035.526018:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527892992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1296us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.526030:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789480035.526059:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480035.526576:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527893120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480035.526627:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480035.527079:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893120 00000100:00100000:1.0:1789480035.527087:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893120 00000100:00100000:1.0:1789480035.527153:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789480035.527162:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527893120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789480035.527182:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480035.527244:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527893120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480035.527251:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789480035.528543:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789480035.528589:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb505f80 x1876405527893120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480035.528615:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527893120:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789480035.530721:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987c0dc00 x1876405527892992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480035.530745:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527892992:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789480035.601499:0:13541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:47:14 (1789480034) === 00010000:00010000:3.0:1789480035.654710:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480036.024142:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.024301:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872768 00000100:00100000:0.0:1789480036.024310:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872768 00000100:00100000:0.0:1789480036.024378:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:0.0:1789480036.024389:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507872768:12345-192.168.206.44@tcp:41:mkdir.0 00000004:00000024:0.0:1789480036.024433:0:12158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789480036.024525:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507872768:12345-192.168.206.44@tcp:41:mkdir.0 Request processed in 138us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.024547:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00080000:3.0:1789480036.024887:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480036.025804:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.025880:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507872896 00000100:00100000:3.0:1789480036.025887:0:6529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507872896 00000100:00100000:3.0:1789480036.025928:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:3.0:1789480036.025937:0:6529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:10520:x1876405507872896:12345-192.168.206.44@tcp:700:mkdir.0 00000100:00100000:3.0:1789480036.026006:0:6529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:10520:x1876405507872896:12345-192.168.206.44@tcp:700:mkdir.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480036.026013:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1789480036.030542:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.030631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873152 00000100:00100000:0.0:1789480036.030641:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873152 00000100:00100000:0.0:1789480036.030695:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1789480036.030705:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:10520:x1876405507873152:12345-192.168.206.44@tcp:36:mkdir.0 00010000:00010000:0.0:1789480036.030756:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480036.030836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d242 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ce expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.030855:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a97c2e500) 00010000:00010000:0.0:1789480036.030866:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480036.030943:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.030955:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.030966:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.030994:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031002:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031009:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031894:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031912:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031921:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480036.031937:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b2922d7 reply state 0000000081a64886 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031947:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031953:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:0.0:1789480036.031956:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480036.031959:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789480036.031963:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789480036.031970:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031976:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031982:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031989:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.031993:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.031999:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.032017:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16e00) 00010000:00010000:0.0:1789480036.032019:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480036.032023:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.032029:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480036.032041:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b2922d7 reply state 0000000081a64886 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.032049:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.032055:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480036.032057:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480036.032059:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789480036.033338:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10520:x1876405507873152:12345-192.168.206.44@tcp:36:mkdir.0 Request processed in 2627us (2798us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789480036.033348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1789480036.037288:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480036.037313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527893248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480036.037376:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480036.040460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893248 00000100:00100000:3.0:1789480036.040472:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893248 00000100:00100000:3.0:1789480036.040536:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789480036.040546:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527893248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480036.040573:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480036.040657:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527893248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480036.040664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789480036.042266:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527893248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480036.062574:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.062825:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873280 00000100:00100000:0.0:1789480036.062835:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873280 00000100:00100000:0.0:1789480036.062892:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1789480036.062902:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10521:x1876405507873280:12345-192.168.206.44@tcp:101:chmod.0 00010000:00010000:0.0:1789480036.062920:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480036.062951:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a61 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063009:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063022:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063033:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480036.063072:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789480036.063075:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480036.063107:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063132:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a61 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063150:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a61 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.063158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16e00) 00010000:00010000:0.0:1789480036.063161:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480036.063164:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da600, rc 0) 00000100:00100000:0.0:1789480036.063275:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:10521:x1876405507873280:12345-192.168.206.44@tcp:101:chmod.0 Request processed in 374us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.063282:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1789480036.067972:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.068144:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873536 00000100:00100000:2.0:1789480036.068153:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873536 00000100:00100000:2.0:1789480036.068237:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1789480036.068247:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:10521:x1876405507873536:12345-192.168.206.44@tcp:36:chmod.0 00010000:00010000:2.0:1789480036.068296:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480036.068320:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d3bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a61 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.068340:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16e00) 00010000:00010000:2.0:1789480036.068351:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480036.068376:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.068388:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.068411:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480036.068604:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077c4018b reply state 00000000814835fd transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.068616:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.068622:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:2.0:1789480036.068625:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789480036.068627:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789480036.068634:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789480036.068715:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:10521:x1876405507873536:12345-192.168.206.44@tcp:36:chmod.0 Request processed in 469us (749us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789480036.068722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:3.0:1789480036.125843:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.125951:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873664 00000100:00100000:0.0:1789480036.125968:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873664 00000100:00100000:0.0:1789480036.126029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1789480036.126040:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:10522:x1876405507873664:12345-192.168.206.44@tcp:101:chown.0 00010000:00010000:0.0:1789480036.126061:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480036.126081:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a68 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126145:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126173:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480036.126262:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789480036.126266:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480036.126300:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126324:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d3ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a68 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126528:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a68 expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.126537:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:0.0:1789480036.126540:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480036.126544:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dba00, rc 0) 00000100:00100000:0.0:1789480036.126606:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+10:10522:x1876405507873664:12345-192.168.206.44@tcp:101:chown.0 Request processed in 568us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.126613:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1789480036.144513:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.145155:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873792 00000100:00100000:1.0:1789480036.145166:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873792 00000100:00100000:1.0:1789480036.145258:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1789480036.145268:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+10:10522:x1876405507873792:12345-192.168.206.44@tcp:101:chown.0 00010000:00010000:1.0:1789480036.145288:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480036.145311:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d3d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a6f expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145402:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145417:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145441:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145453:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145460:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145467:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145544:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145551:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145558:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480036.145596:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480036.145600:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480036.145617:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145639:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145645:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145653:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145658:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480036.145663:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145670:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145681:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:1.0:1789480036.145684:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480036.145688:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145694:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145705:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145712:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145718:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145728:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480036.145731:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145737:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145745:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a6a8be16100) 00010000:00010000:1.0:1789480036.145747:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480036.145750:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145757:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d3e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145781:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d3d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a6f expref: 12 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145793:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a6f expref: 11 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.145801:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:1.0:1789480036.145803:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480036.145805:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bce00, rc 0) 00000100:00100000:1.0:1789480036.145870:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10522:x1876405507873792:12345-192.168.206.44@tcp:101:chown.0 Request processed in 604us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.145878:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:3.0:1789480036.150879:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.150981:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507873920 00000100:00100000:0.0:1789480036.150989:0:6532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507873920 00000100:00100000:0.0:1789480036.151040:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1789480036.151049:0:6532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10522:x1876405507873920:12345-192.168.206.44@tcp:900:chown.0 00000100:00100000:0.0:1789480036.151126:0:6532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10522:x1876405507873920:12345-192.168.206.44@tcp:900:chown.0 Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.151134:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:3.0:1789480036.153920:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.154133:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874176 00000100:00100000:1.0:1789480036.154158:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874176 00000100:00100000:1.0:1789480036.154249:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:1.0:1789480036.154259:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10522:x1876405507874176:12345-192.168.206.44@tcp:36:chown.0 00010000:00010000:1.0:1789480036.154308:0:8915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480036.154341:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a6f expref: 11 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.154360:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:1.0:1789480036.154365:0:8915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480036.154387:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.154399:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.154409:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480036.159299:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1789480036.159417:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159441:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159448:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159454:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.159459:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159467:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159483:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480036.159486:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480036.159490:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480036.159497:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000787aa9fc reply state 000000009f6da586 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159502:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d3a7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.159511:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.159518:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:1.0:1789480036.159520:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789480036.159523:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789480036.159527:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159532:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480036.159534:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789480036.159537:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159541:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.159544:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159549:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159555:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:0.0:1789480036.159557:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480036.159559:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159563:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d3ae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159574:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159580:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159590:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159594:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.159597:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159602:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159608:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:0.0:1789480036.159611:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789480036.159613:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.159619:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d3c3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789480036.159623:0:8915:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1789480036.159643:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10522:x1876405507874176:12345-192.168.206.44@tcp:36:chown.0 Request processed in 5382us (5729us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789480036.159662:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00010000:00010000:2.0:1789480036.159690:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159698:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159709:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159713:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480036.159717:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159732:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159739:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16700) 00010000:00010000:2.0:1789480036.159741:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789480036.159744:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.159749:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243d3f4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480036.191994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.192038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.192069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.192116:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.192146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874432 00000100:00100000:3.0:1789480036.192155:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874432 00000100:00100000:3.0:1789480036.192239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874560 00000100:00100000:3.0:1789480036.192243:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874560 00000100:00100000:3.0:1789480036.192261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874688 00000100:00100000:3.0:1789480036.192264:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874688 00000100:00100000:3.0:1789480036.192278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:3.0:1789480036.192287:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507874432:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480036.192488:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:1.0:1789480036.192498:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507874560:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480036.192551:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb034700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507874560:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 56us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.192558:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:1.0:1789480036.192576:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:1.0:1789480036.192582:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507874688:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480036.192607:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507874688:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.192612:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:0.0:1789480036.192683:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874304 00000100:00100000:0.0:1789480036.192688:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874304 00000100:00100000:0.0:1789480036.192724:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 345 00000100:00100000:0.0:1789480036.192732:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507874304:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480036.192757:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507874304:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.192763:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 345 00000100:00080000:0.0:1789480036.192806:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480036.192811:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480036.192981:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507874432:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 693us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480036.192988:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:3.0:1789480036.207472:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.207629:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507874816 00000100:00100000:1.0:1789480036.207639:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507874816 00000100:00100000:1.0:1789480036.207701:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:1.0:1789480036.207712:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:10523:x1876405507874816:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:1.0:1789480036.207734:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480036.207755:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a76 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480036.211283:0:8915:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3479us 00010000:00010000:1.0:1789480036.232876:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.232896:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.232915:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.232931:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.232939:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.232946:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233059:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233068:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233075:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480036.233116:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480036.233120:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480036.233156:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233168:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233174:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233211:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233218:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480036.233223:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233231:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233242:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:1.0:1789480036.233245:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480036.233250:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233256:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233266:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233272:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233277:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233281:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480036.233283:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233297:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233304:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a698745eb00) 00010000:00010000:1.0:1789480036.233306:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480036.233309:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233314:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d409 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233362:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bce00/0xdaa289fda243d3fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a76 expref: 8 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233376:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a76 expref: 7 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.233383:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:1.0:1789480036.233385:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789480036.233387:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bda00, rc 0) 00000100:00100000:1.0:1789480036.233463:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb037480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10523:x1876405507874816:12345-192.168.206.44@tcp:101:touch.500 Request processed in 25752us (26001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.233472:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1789480036.240631:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.240708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875072 00000100:00100000:2.0:1789480036.240717:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875072 00000100:00100000:2.0:1789480036.240770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:2.0:1789480036.240780:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10523:x1876405507875072:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:2.0:1789480036.240799:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480036.240817:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d417 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a7d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240916:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240931:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240943:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240958:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240977:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.240985:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480036.241673:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789480036.243271:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d42c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243302:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243530:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243537:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243543:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243549:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480036.243554:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243561:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243587:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:2.0:1789480036.243589:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480036.243594:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243599:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d41e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480036.243610:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe8103f5 reply state 00000000fc52e26b transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243619:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243624:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8a6987bf2200) 00010000:00010000:2.0:1789480036.243626:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480036.243629:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789480036.243664:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d417 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a7d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243677:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a7d expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.243683:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2c00) 00010000:00010000:2.0:1789480036.243686:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480036.243688:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81475000, rc 0) 00000100:00100000:2.0:1789480036.243748:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+10:10523:x1876405507875072:12345-192.168.206.44@tcp:101:touch.500 Request processed in 2968us (3124us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789480036.243756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1789480036.250746:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.250820:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875328 00000100:00100000:2.0:1789480036.250830:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875328 00000100:00100000:2.0:1789480036.250885:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:2.0:1789480036.250896:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+10:10523:x1876405507875328:12345-192.168.206.44@tcp:36:touch.500 00010000:00010000:2.0:1789480036.250949:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480036.250973:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d42c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a7d expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.250991:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2c00) 00010000:00010000:2.0:1789480036.251002:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480036.251049:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.251060:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.251070:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480036.251177:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee59db52 reply state 00000000ab0b0115 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.251215:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.251222:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:2.0:1789480036.251225:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480036.251228:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480036.251306:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10523:x1876405507875328:12345-192.168.206.44@tcp:36:touch.500 Request processed in 412us (568us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789480036.251325:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:1.0:1789480036.262657:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.262754:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875456 00000100:00100000:2.0:1789480036.262763:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875456 00000100:00100000:2.0:1789480036.262816:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:2.0:1789480036.262826:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:10523:x1876405507875456:12345-192.168.206.44@tcp:101:touch.500 00010000:00010000:2.0:1789480036.262847:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480036.262866:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d441 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a84 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.262918:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a84 expref: 12 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.262932:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d441 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a84 expref: 12 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.262949:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:2.0:1789480036.262952:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480036.262956:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81475000, rc 0) 00000100:00100000:2.0:1789480036.263012:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+12:10523:x1876405507875456:12345-192.168.206.44@tcp:101:touch.500 Request processed in 188us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480036.263019:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:3.0:1789480036.265763:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.265859:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875584 00000100:00100000:1.0:1789480036.265868:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875584 00000100:00100000:1.0:1789480036.265915:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1789480036.265937:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876405507875584:12345-192.168.206.44@tcp:8:touch.500 00010000:00080000:1.0:1789480036.265969:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 405 last 0 00000020:00000080:1.0:1789480036.265999:0:8436:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d448 00002000:00100000:1.0:1789480036.266009:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7386f76-6ebd-4087-bc50-a71a216590e4/ffff8a6a866c8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480036.266026:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789480036.266106:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480036.266132:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8a6a866c8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480036.266236:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507875584:12345-192.168.206.44@tcp:8:touch.500 Request processed in 299us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.266244:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1789480036.272677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480036.272846:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875712 00000100:00100000:3.0:1789480036.272856:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875712 00000100:00100000:3.0:1789480036.272928:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:3.0:1789480036.272938:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507875712:12345-192.168.206.44@tcp:2:touch.500 00000001:00080000:1.0:1789480036.274231:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1789480036.274240:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000100:00100000:3.0:1789480036.274449:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988806300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:0:x1876405507875712:12345-192.168.206.44@tcp:2:touch.500 Request processed in 1509us (1778us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789480036.274458:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00080000:0.0:1789480036.275930:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480036.276762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.277138:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507875968 00000100:00100000:0.0:1789480036.277147:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507875968 00000100:00100000:0.0:1789480036.277231:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1789480036.277241:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+12:10523:x1876405507875968:12345-192.168.206.44@tcp:35:touch.500 00000100:00100000:0.0:1789480036.277511:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+13:10523:x1876405507875968:12345-192.168.206.44@tcp:35:touch.500 Request processed in 271us (753us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789480036.277519:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1789480036.293925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.294016:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507876096 00000100:00100000:2.0:1789480036.294025:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507876096 00000100:00100000:2.0:1789480036.294079:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:2.0:1789480036.294088:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+13:10524:x1876405507876096:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:2.0:1789480036.294117:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480036.294145:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a8b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294243:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294257:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294268:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480036.294309:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789480036.294312:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480036.294353:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294376:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a8b expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294393:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a8b expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.294400:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:2.0:1789480036.294403:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480036.294406:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81474c00, rc 0) 00000100:00100000:2.0:1789480036.294469:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+14:10524:x1876405507876096:12345-192.168.206.44@tcp:101:rm.0 Request processed in 383us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480036.294476:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1789480036.298126:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.300657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507876352 00000100:00100000:1.0:1789480036.300670:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507876352 00000100:00100000:1.0:1789480036.300737:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:1.0:1789480036.300746:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+14:10524:x1876405507876352:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:1.0:1789480036.300777:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480036.300798:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a92 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480036.300888:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789480036.301022:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d45d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a92 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.301048:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:1.0:1789480036.301051:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480036.301056:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a92 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480036.301069:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd600, rc 0) 00000100:00100000:1.0:1789480036.301149:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+15:10524:x1876405507876352:12345-192.168.206.44@tcp:101:rm.0 Request processed in 403us (3031us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789480036.301156:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:3.0:1789480036.304583:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.304667:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507876480 00000100:00100000:0.0:1789480036.304676:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507876480 00000100:00100000:0.0:1789480036.304727:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1789480036.304736:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+15:10524:x1876405507876480:12345-192.168.206.44@tcp:37:rm.0 00000100:00100000:0.0:1789480036.308338:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+15:10524:x1876405507876480:12345-192.168.206.44@tcp:37:rm.0 Request processed in 3594us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480036.308350:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1789480036.317450:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.317546:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507876736 00000100:00100000:1.0:1789480036.317555:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507876736 00000100:00100000:1.0:1789480036.317609:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1789480036.317619:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+15:10524:x1876405507876736:12345-192.168.206.44@tcp:35:rm.0 00000100:00100000:1.0:1789480036.317831:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+16:10524:x1876405507876736:12345-192.168.206.44@tcp:35:rm.0 Request processed in 213us (389us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789480036.317839:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1789480036.321164:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.322507:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507876992 00000100:00100000:2.0:1789480036.322532:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507876992 00000100:00100000:2.0:1789480036.322581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:2.0:1789480036.322590:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+16:10524:x1876405507876992:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:2.0:1789480036.322612:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480036.322631:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d46b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2a99 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.322722:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d472 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.322735:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d472 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.322745:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d472 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480036.322754:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789480036.322846:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d46b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a99 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.322863:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d472 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a99 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.322870:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:2.0:1789480036.322873:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480036.322876:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789480036.322950:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507876992:12345-192.168.206.44@tcp:101:rm.0 Request processed in 361us (1794us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789480036.322956:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1789480036.330700:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480036.330802:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507877120 00000100:00100000:1.0:1789480036.330811:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507877120 00000100:00100000:1.0:1789480036.330865:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:1.0:1789480036.330875:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507877120:12345-192.168.206.44@tcp:41:rm.0 00000004:00000024:1.0:1789480036.330927:0:12158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789480036.330993:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507877120:12345-192.168.206.44@tcp:41:rm.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480036.331000:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:3.0:1789480036.334359:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480036.334441:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507877248 00000100:00100000:2.0:1789480036.334450:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507877248 00000100:00100000:2.0:1789480036.334508:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:2.0:1789480036.334518:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507877248:12345-192.168.206.44@tcp:101:rm.0 00010000:00010000:2.0:1789480036.334537:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480036.334556:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d480 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2aa0 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334616:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334630:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334642:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334654:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334661:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334667:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334743:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334751:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334775:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480036.334810:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789480036.334814:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480036.334831:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334842:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334850:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334857:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334864:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334869:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480036.334873:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334881:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334891:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:2.0:1789480036.334894:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480036.334898:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334914:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475400/0xdaa289fda243d487 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334928:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334934:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334940:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334945:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480036.334948:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334954:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334961:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8a6987bf2200) 00010000:00010000:2.0:1789480036.334964:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480036.334966:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334972:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1600/0xdaa289fda243d48e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.334993:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d480 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa0 expref: 20 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.335007:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa0 expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480036.335019:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:2.0:1789480036.335021:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480036.335023:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:2.0:1789480036.335083:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+19:10524:x1876405507877248:12345-192.168.206.44@tcp:101:rm.0 Request processed in 566us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480036.335090:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:2.0:1789480036.346511:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.346595:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507877504 00000100:00100000:0.0:1789480036.346603:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507877504 00000100:00100000:0.0:1789480036.346652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:0.0:1789480036.346660:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+19:10524:x1876405507877504:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:0.0:1789480036.346706:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789480036.346729:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243d495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa0 expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346747:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475000/0xdaa289fda243d441 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a84 expref: 18 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346756:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:0.0:1789480036.346778:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81474c00/0xdaa289fda243d456 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a8b expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346788:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:0.0:1789480036.346791:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480036.346809:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346821:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346830:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346840:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346848:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346855:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346955:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346963:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.346969:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480036.347151:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789480036.347167:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405270975911ns, next at 406270974108ns, rc = 0 00010000:00010000:0.0:1789480036.347257:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347267:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347274:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347280:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347286:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347292:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347319:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480036.347441:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480036.347448:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480036.347454:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480036.347458:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480036.347476:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480036.347486:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:3.0:1789480036.347489:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789480036.347493:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480036.347499:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243d4b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480036.347510:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480036.347513:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480036.347514:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480036.347549:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347557:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347564:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347569:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.347573:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347589:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347598:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:0.0:1789480036.347600:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789480036.347603:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347610:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4aa lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347624:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347630:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347636:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347641:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.347644:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347650:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347657:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:0.0:1789480036.347659:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480036.347663:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347679:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d49c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480036.347690:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fd9c0ff reply state 00000000384b18c5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347702:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.347709:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8a6987bf2200) 00010000:00010000:0.0:1789480036.347712:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480036.347715:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480036.347817:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507877504:12345-192.168.206.44@tcp:36:rm.0 Request processed in 1156us (1313us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789480036.347825:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:3.0:1789480036.352630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.352696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507877760 00000100:00100000:0.0:1789480036.352705:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507877760 00000100:00100000:0.0:1789480036.352760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1789480036.352771:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507877760:12345-192.168.206.44@tcp:35:rm.0 00000100:00100000:0.0:1789480036.353440:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+19:10524:x1876405507877760:12345-192.168.206.44@tcp:35:rm.0 Request processed in 668us (815us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789480036.353449:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1789480036.361238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480036.361314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878016 00000100:00100000:0.0:1789480036.361323:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878016 00000100:00100000:0.0:1789480036.361386:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1789480036.361396:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:10524:x1876405507878016:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:0.0:1789480036.361455:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789480036.361491:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d472 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a99 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361512:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a76 expref: 18 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361523:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a698745e700) 00010000:00010000:0.0:1789480036.361539:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d3d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a68 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361547:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf5b00) 00010000:00010000:0.0:1789480036.361553:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480036.361571:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361582:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361591:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361603:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361609:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361616:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361682:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361695:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361702:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480036.361897:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789480036.361910:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361917:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361923:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361928:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.361932:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361939:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361946:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:0.0:1789480036.361949:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789480036.361952:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361958:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243d4c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361973:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361985:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361990:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.361995:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480036.361998:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.362004:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.362012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480036.362015:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480036.362017:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.362023:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243d4b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480036.362035:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016132d2f reply state 000000005eadd219 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.362046:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480036.362052:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a6a8be16a00) 00010000:00010000:0.0:1789480036.362054:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480036.362056:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480036.362130:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:10524:x1876405507878016:12345-192.168.206.44@tcp:36:rm.0 Request processed in 735us (900us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789480036.362144:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00010000:00010000:1.0:1789480036.677304:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480037.702088:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480038.086241:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527893504:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086306:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527894016:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086397:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086431:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527894528:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086451:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086477:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789480038.086482:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527893632:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086527:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086544:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527894144:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086576:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527894656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086591:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.086619:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893504 00000100:00100000:0.0:1789480038.086625:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893504 00000100:00100000:0.0:1789480038.086654:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894016 00000100:00100000:0.0:1789480038.086657:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894016 00000100:00100000:0.0:1789480038.086679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894528 00000100:00100000:0.0:1789480038.086682:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894528 00000100:00100000:0.0:1789480038.086694:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894144 00000100:00100000:0.0:1789480038.086696:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894144 00000100:00100000:0.0:1789480038.086708:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894656 00000100:00100000:0.0:1789480038.086710:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894656 00000100:00100000:0.0:1789480038.086725:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789480038.086732:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527893504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086788:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527893504:12345-0@lo:400:kworker.0 Request processed in 56us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.086796:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789480038.086813:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789480038.086820:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527894016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086845:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527894016:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.086851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789480038.086860:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789480038.086865:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527894528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086886:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527894528:12345-0@lo:400:kworker.0 Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.086890:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789480038.086899:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789480038.086903:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527894144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086923:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527894144:12345-0@lo:400:kworker.0 Request processed in 21us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.086929:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789480038.086937:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789480038.086942:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527894656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.086964:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527894656:12345-0@lo:400:kworker.0 Request processed in 22us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.086969:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:0.0:1789480038.086989:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480038.086993:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789480038.087243:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987fadc00 x1876405527894144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480038.087257:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527894144:0@lo:400:kworker.0 00010000:00080000:0.0:1789480038.087266:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987fad180 x1876405527894656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480038.087274:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527894656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.087282:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527893504:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.087289:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527894016:0@lo:400:kworker.0 00000100:00100000:0.0:1789480038.087296:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527894528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087599:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527893760:0@lo:400:kworker.0 00000100:00100000:1.0:1789480038.087628:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527893376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.087659:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527894272:0@lo:400:kworker.0 00000100:00100000:1.0:1789480038.087660:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.087680:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480038.087680:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527893888:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087697:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527894784:0@lo:400:kworker.0 00000100:00100000:1.0:1789480038.087700:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.087714:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480038.087716:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527894400:0@lo:400:kworker.0 00000100:00100000:1.0:1789480038.087733:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.087739:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893760 00000100:00100000:2.0:1789480038.087743:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893760 00000100:00100000:2.0:1789480038.087770:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789480038.087776:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527893760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087810:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527893760:12345-0@lo:400:kworker.0 Request processed in 34us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.087816:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789480038.087834:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893632 00000100:00100000:2.0:1789480038.087837:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893632 00000100:00100000:2.0:1789480038.087870:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893888 00000100:00100000:2.0:1789480038.087874:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893888 00000100:00100000:2.0:1789480038.087887:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789480038.087899:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527893632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480038.087922:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527894912:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087936:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527893632:12345-0@lo:400:kworker.0 Request processed in 39us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.087942:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789480038.087950:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.087954:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789480038.087959:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527893888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.087990:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527893888:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.087995:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789480038.088012:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527893376 00000100:00100000:2.0:1789480038.088015:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527893376 00000100:00100000:2.0:1789480038.088036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789480038.088041:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527893376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088066:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527893376:12345-0@lo:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.088071:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789480038.088093:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894272 00000100:00100000:2.0:1789480038.088096:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894272 00000100:00100000:2.0:1789480038.088116:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894784 00000100:00100000:2.0:1789480038.088118:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894784 00000100:00100000:2.0:1789480038.088127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894400 00000100:00100000:2.0:1789480038.088129:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894400 00000100:00100000:2.0:1789480038.088138:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527894912 00000100:00100000:2.0:1789480038.088140:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527894912 00000100:00100000:2.0:1789480038.088151:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789480038.088156:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527894272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088181:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527894272:12345-0@lo:400:kworker.0 Request processed in 26us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.088213:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789480038.088224:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789480038.088229:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527894784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088256:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527894784:12345-0@lo:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.088261:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789480038.088270:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789480038.088276:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527894400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088314:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527894400:12345-0@lo:400:kworker.0 Request processed in 38us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.088320:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789480038.088332:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789480038.088337:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527894912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088363:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527894912:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.088379:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789480038.088419:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527893632:0@lo:400:kworker.0 00000100:00080000:2.0:1789480038.088440:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480038.088443:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480038.088455:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527893760:0@lo:400:kworker.0 00010000:00080000:2.0:1789480038.088465:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987faf100 x1876405527894272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480038.088474:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527894272:0@lo:400:kworker.0 00010000:00080000:2.0:1789480038.088483:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987fadf80 x1876405527894784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480038.088498:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527894784:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088536:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527893376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480038.088545:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527893888:0@lo:400:kworker.0 00010000:00080000:2.0:1789480038.088554:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987fad500 x1876405527894400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480038.088562:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527894400:0@lo:400:kworker.0 00010000:00080000:2.0:1789480038.088570:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987face00 x1876405527894912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480038.088578:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987face00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527894912:0@lo:400:kworker.0 00000100:00100000:3.0:1789480038.089456:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480038.089470:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527895040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480038.092687:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.093314:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895040 00000100:00100000:2.0:1789480038.093323:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895040 00000100:00100000:2.0:1789480038.093386:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789480038.093396:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527895040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480038.093438:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480038.093489:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527895040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.093496:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789480038.093554:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527895040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480038.596588:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480038.596617:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527895168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480038.596708:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480038.596893:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895168 00000100:00100000:2.0:1789480038.596903:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895168 00000100:00100000:2.0:1789480038.596968:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789480038.596980:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527895168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480038.597022:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480038.597084:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527895168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480038.597101:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:3.0:1789480038.597228:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff0a80 x1876405527895168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480038.597251:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527895168:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1789480038.608292:0:9887:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407532098289ns, next at 408532094667ns, rc = 0 00000100:00100000:0.0:1789480038.608337:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480038.608361:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527895296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480038.608460:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480038.608539:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895296 00000100:00100000:0.0:1789480038.608547:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895296 00000100:00100000:0.0:1789480038.608602:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789480038.608612:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527895296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480038.608655:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480038.608815:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527895296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480038.608824:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789480038.608881:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e90e00 x1876405527895296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480038.608903:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527895296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789480038.728936:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480039.754831:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480040.645524:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480040.645554:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527895424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480040.645657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480040.645834:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895424 00000100:00100000:2.0:1789480040.645845:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895424 00000100:00100000:2.0:1789480040.645926:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789480040.645939:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527895424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480040.645976:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480040.646035:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527895424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480040.646042:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1789480040.646096:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff2300 x1876405527895424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480040.646117:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527895424:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789480040.646455:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480040.652273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480040.652303:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527895552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480040.652388:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480040.652470:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895552 00000100:00100000:2.0:1789480040.652479:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895552 00000100:00100000:2.0:1789480040.652553:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789480040.652563:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527895552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480040.652592:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480040.652659:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527895552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480040.652666:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1789480040.652695:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789480040.652729:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff2300 x1876405527895552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480040.652774:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527895552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480040.777149:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789480040.988964:0:13690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789480041.165733:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480041.165834:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480041.165973:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527895680 00000100:00100000:3.0:1789480041.165999:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527895680 00000100:00100000:3.0:1789480041.166059:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789480041.166069:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527895680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480041.166112:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480041.176994:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527895680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10911us (11145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480041.177011:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789480041.183317:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527895680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480041.305638:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305796:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305842:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480041.305869:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878400 00000100:00100000:1.0:1789480041.305877:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878400 00000100:00100000:1.0:1789480041.305931:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878656 00000100:00100000:1.0:1789480041.305935:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878656 00000100:00100000:1.0:1789480041.305946:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878272 00000100:00100000:1.0:1789480041.305948:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878272 00000100:00100000:1.0:1789480041.305959:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878784 00000100:00100000:1.0:1789480041.305975:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878784 00000100:00100000:1.0:1789480041.305996:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:1.0:1789480041.306005:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507878400:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480041.306074:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507878400:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480041.306081:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:1.0:1789480041.306098:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:1.0:1789480041.306103:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507878656:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480041.306127:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507878656:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480041.306132:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:1.0:1789480041.306142:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:1.0:1789480041.306147:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+18:2399:x1876405507878272:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480041.306171:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+18:2399:x1876405507878272:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480041.306222:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:1.0:1789480041.306235:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:1.0:1789480041.306242:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507878784:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480041.306265:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb036300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507878784:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480041.306270:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:1.0:1789480041.306287:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878528 00000100:00100000:1.0:1789480041.306290:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878528 00000100:00100000:1.0:1789480041.306312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:1.0:1789480041.306326:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507878528:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480041.306352:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507878528:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480041.306358:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00080000:1.0:1789480041.306377:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480041.306387:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480041.306390:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480041.306426:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878144 00000100:00100000:2.0:1789480041.306431:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878144 00000100:00100000:2.0:1789480041.306459:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 347 00000100:00100000:2.0:1789480041.306465:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507878144:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480041.306490:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507878144:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480041.306495:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 347 00010000:00010000:0.0:1789480041.801541:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789480042.118336:0:13738:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1a16d7b0 20000000:00000080:0.0:1789480042.118352:0:13738:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6987fdc400 uarg=0000000000000000 20000000:01000000:0.0:1789480042.118405:0:13738:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789480042.118411:0:13738:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789480042.118415:0:13738:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789480042.120652:0:13739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789480042.120771:0:13738:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789480042.125869:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789480042.127759:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789480042.127804:0:13738:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789480042.127825:0:13738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789480042.127845:0:13738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127863:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d35a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127870:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d368 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127876:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d376 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127882:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d384 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127903:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127909:0:13738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127915:0:13738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127949:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.127961:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 12 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.128130:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527895808:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480042.128282:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.128291:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.128299:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527895936:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480042.128330:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.128338:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 23 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.128359:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896064:0@lo:104: 00000100:00100000:0.0:1789480042.129958:0:13738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480042.130117:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789480042.130133:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896064 00000100:00100000:0.0:1789480042.130141:0:6504:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896064 00000100:00100000:0.0:1789480042.130219:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480042.130231:0:6504:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986b27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896064:12345-0@lo:104: 00010000:00010000:0.0:1789480042.130247:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.130305:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480042.130311:0:6504:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986b27850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896064:12345-0@lo:104: Request processed in 84us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480042.130319:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789480042.130415:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.130427:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 23 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.130438:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896192:0@lo:104: 00000100:00100000:1.0:1789480042.131494:0:13738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789480042.131539:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131551:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 23 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131560:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896320:0@lo:104: 00000100:00100000:1.0:1789480042.131581:0:13738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480042.131603:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896192 00000100:00100000:1.0:1789480042.131608:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896192 00000100:00100000:1.0:1789480042.131631:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896320 00000100:00100000:1.0:1789480042.131634:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896320 00000100:00100000:1.0:1789480042.131645:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480042.131651:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:13738:x1876405527896192:12345-0@lo:104: 00010000:00010000:1.0:1789480042.131662:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131700:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789480042.131706:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+4:13738:x1876405527896192:12345-0@lo:104: Request processed in 55us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480042.131712:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480042.131736:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789480042.131741:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896320:12345-0@lo:104: 00010000:00010000:1.0:1789480042.131747:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131767:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480042.131774:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131781:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480042.131786:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131791:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789480042.131794:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131795:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896320:12345-0@lo:104: Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480042.131801:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 10000000:00010000:3.0:1789480042.131802:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480042.131807:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480042.131825:0:13738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131833:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131834:0:13738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 23 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131839:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789480042.131842:0:13738:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896448:0@lo:104: 00010000:00010000:3.0:1789480042.131856:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131862:0:13738:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480042.131863:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243d384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d38b expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131878:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896448 00010000:00010000:3.0:1789480042.131881:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789480042.131881:0:6503:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896448 00010000:00010000:3.0:1789480042.131884:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131889:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480042.131893:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131895:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789480042.131900:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131900:0:6503:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896448:12345-0@lo:104: 10000000:00010000:3.0:1789480042.131907:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131907:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480042.131913:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480042.131926:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.131931:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789480042.131932:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789480042.131935:0:6503:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6a679393-20ef-489d-b204-2797ec519e97+3:13738:x1876405527896448:12345-0@lo:104: Request processed in 36us (73us total) trans 0 rc 0/0 00010000:00010000:3.0:1789480042.131939:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131941:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:3.0:1789480042.131945:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7200/0xdaa289fda243d376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d37d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131954:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480042.131957:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.131958:0:13738:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7780 going to sleep for 11 seconds 00010000:00010000:3.0:1789480042.131969:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480042.131972:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.131979:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480042.131985:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480042.131990:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480042.132005:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132010:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480042.132025:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132031:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243d368 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d36f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132039:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480042.132042:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132047:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480042.132049:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132064:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480042.132069:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480042.132074:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789480042.132087:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132092:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480042.132099:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132104:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bcc00/0xdaa289fda243d35a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243d361 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132121:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480042.132123:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480042.132124:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480042.132142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527896704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132172:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480042.132212:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480042.132218:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527896576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480042.132260:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527896832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480042.132292:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480042.132303:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527896960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132322:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480042.132361:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896704 00000100:00100000:3.0:1789480042.132365:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896704 00010000:00010000:3.0:1789480042.132384:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 24 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.132410:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896576 00000100:00100000:3.0:1789480042.132412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896576 00010000:00010000:3.0:1789480042.132424:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 25 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.132433:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896832 00000100:00100000:3.0:1789480042.132435:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896832 00010000:00010000:3.0:1789480042.132442:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 26 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.132450:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527896960 00000100:00100000:3.0:1789480042.132451:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527896960 00010000:00010000:3.0:1789480042.132459:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 27 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.132470:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789480042.132476:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+27:3648:x1876405527896704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480042.132485:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480042.132490:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 27 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132498:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 27 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132523:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480042.132552:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+27:3648:x1876405527896704:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480042.132557:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789480042.132572:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789480042.132584:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+26:3648:x1876405527896576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480042.132591:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480042.132596:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 26 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132603:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 26 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132612:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480042.132632:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+26:3648:x1876405527896576:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480042.132637:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789480042.132648:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789480042.132653:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+25:3645:x1876405527896832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480042.132659:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480042.132663:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 25 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132672:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 25 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132681:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480042.132714:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+25:3645:x1876405527896832:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480042.132721:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789480042.132727:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480042.132735:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789480042.132742:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527896960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480042.132749:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480042.132754:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 24 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132762:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 24 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.132771:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480042.132788:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+24:3645:x1876405527896960:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480042.132793:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789480042.132829:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527896960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132837:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527896832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132867:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527896576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480042.132873:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527896704:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1789480042.134460:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789480042.134492:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789480042.134499:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1789480042.134528:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134539:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134546:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134552:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480042.134556:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134575:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134591:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8a6987bf2200) 00010000:00010000:2.0:1789480042.134594:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480042.134599:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134606:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d425 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134625:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134632:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134637:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134643:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480042.134646:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134652:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134659:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a6987bf2f00) 00010000:00010000:2.0:1789480042.134662:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480042.134665:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134679:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81475a00/0xdaa289fda243d43a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134697:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134703:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134709:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134714:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480042.134717:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134723:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134730:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xafd88f8a (ffff8a6987bf2200) 00010000:00010000:2.0:1789480042.134733:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480042.134735:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134740:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d4a3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xafd88f8a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134752:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134758:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134899:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134904:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480042.134907:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134913:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134921:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a6a8be16a00) 00010000:00010000:2.0:1789480042.134924:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480042.134926:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.134932:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d4bf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.136097:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480042.136252:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6800/0xdaa289fda243d38b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d384 expref: 23 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.136280:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896064:0@lo:104: 00010000:00010000:1.0:1789480042.136302:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243d37d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d376 expref: 22 pid: 6515 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.136312:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896192:0@lo:104: 00010000:00010000:1.0:1789480042.136321:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243d36f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d368 expref: 21 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.136330:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896320:0@lo:104: 00010000:00010000:1.0:1789480042.136341:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243d361 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243d35a expref: 20 pid: 6512 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.136376:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527897088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789480042.136442:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987cbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527896448:0@lo:104: 00000100:00100000:3.0:1789480042.136449:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480042.136497:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897088 00000100:00100000:3.0:1789480042.136503:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897088 00000100:00080000:1.0:1789480042.136552:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480042.136570:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789480042.136579:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527897088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789480042.136616:0:8493:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789480042.136646:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa94c64, atime: 0x6aa94c64, ctime: 0x6aa94c64, blocks: 0x0 00010000:00010000:3.0:1789480042.136654:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.136669:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1789480042.136674:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480042.136680:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.136699:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.136710:0:8493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.136719:0:8493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.136745:0:8493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480042.136790:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480042.136797:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.136809:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7400 already unused, calling callback (ffffffffc0d558b0) 00000100:00100000:0.0:1789480042.136810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00010000:00010000:2.0:1789480042.136815:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.136826:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480042.136826:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527895808:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480042.136870:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480042.136878:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243d4d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.136901:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507878912 00010000:00010000:2.0:1789480042.136902:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480042.136907:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480042.136907:0:13738:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13738:1876405527895936:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480042.136907:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507878912 00010000:00010000:2.0:1789480042.136910:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480042.136931:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.136936:0:13738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480042.136961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1789480042.136969:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507878912:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480042.136980:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480042.136985:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.136997:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.137011:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bc600/0xdaa289fda243d399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a5a expref: 13 pid: 6515 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480042.137022:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480042.137071:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527897088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 492us (624us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789480042.137079:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480042.137101:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2402:x1876405507878912:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480042.137109:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000004:00080000:2.0:1789480042.137318:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6987d72680/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789480042.137325:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527897088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789480042.138166:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480042.138258:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879040 00000100:00100000:3.0:1789480042.138264:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879040 00010000:00010000:3.0:1789480042.138288:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.138330:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:3.0:1789480042.138339:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2401:x1876405507879040:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480042.138363:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480042.138368:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138379:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138406:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a53 expref: 12 pid: 6512 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138419:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138427:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138442:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138449:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138460:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138467:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138483:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480042.138486:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138494:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138513:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480042.138523:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480042.138658:0:13738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.138667:0:13738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480042.138684:0:13738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243d4cd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480042.138700:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:2401:x1876405507879040:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 226us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480042.138709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00010000:00010000:2.0:1789480042.820888:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789480043.038066:0:13787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfdf17f30 20000000:00000080:3.0:1789480043.038086:0:13787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6987f52800 uarg=0000000000000000 20000000:01000000:3.0:1789480043.038129:0:13787:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789480043.038135:0:13787:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789480043.038140:0:13787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789480043.039849:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1789480043.039979:0:13787:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789480043.040054:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1789480043.040080:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1789480043.040094:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1789480043.040105:0:13787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789480043.040125:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040140:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040166:0:13787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040174:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040181:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040247:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040318:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6e00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480043.040322:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040331:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040344:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040351:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480043.040357:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6e00/0xdaa289fda243d4db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480043.204427:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527897216:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.204458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527897600:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.206686:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.206815:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527898112:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.206858:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.206881:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527898624:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.206903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.206926:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789480043.206932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527898240:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.206959:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.206982:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527898752:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.207002:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.207028:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527897344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.207049:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480043.209429:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480043.210373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527897728:0@lo:400:kworker.0 00000100:00100000:1.0:1789480043.210433:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480043.210930:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897216 00000100:00100000:1.0:1789480043.211052:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897216 00000100:00100000:1.0:1789480043.211104:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789480043.211113:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:3648:x1876405527897216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.211419:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527897472:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.211457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.211477:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527897984:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.211501:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480043.211949:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+20:3648:x1876405527897216:12345-0@lo:400:kworker.0 Request processed in 835us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480043.211958:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789480043.211998:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897728 00000100:00100000:1.0:1789480043.212002:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897728 00000100:00100000:1.0:1789480043.212030:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897472 00000100:00100000:1.0:1789480043.212032:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897472 00000100:00100000:1.0:1789480043.212046:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789480043.212052:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527897728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480043.212086:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527897728:12345-0@lo:400:kworker.0 Request processed in 35us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480043.212092:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789480043.212101:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789480043.212106:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527897472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480043.213346:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527897472:12345-0@lo:400:kworker.0 Request processed in 35us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480043.213357:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789480043.214515:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898112 00000100:00100000:3.0:1789480043.214526:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898112 00000100:00100000:3.0:1789480043.214576:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898624 00000100:00100000:3.0:1789480043.214579:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898624 00000100:00100000:3.0:1789480043.214595:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898240 00000100:00100000:3.0:1789480043.214597:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898240 00000100:00100000:3.0:1789480043.214608:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898752 00000100:00100000:3.0:1789480043.214610:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898752 00000100:00100000:3.0:1789480043.214626:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789480043.214633:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527898112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480043.214728:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527898112:12345-0@lo:400:kworker.0 Request processed in 95us (7868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.214734:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789480043.214749:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789480043.214756:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527898624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480043.214784:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987face00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527898624:12345-0@lo:400:kworker.0 Request processed in 29us (7880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.214790:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789480043.214799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789480043.214804:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527898240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480043.214826:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527898240:12345-0@lo:400:kworker.0 Request processed in 22us (7867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.214831:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789480043.214840:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789480043.214845:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527898752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480043.214869:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527898752:12345-0@lo:400:kworker.0 Request processed in 25us (7866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.214874:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789480043.214936:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527897856:0@lo:400:kworker.0 00000100:00080000:3.0:1789480043.214992:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480043.214996:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480043.215030:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527897216:0@lo:400:kworker.0 00000100:00100000:3.0:1789480043.215044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527897728:0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.221897:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897600 00000100:00100000:2.0:1789480043.221913:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897600 00000100:00100000:2.0:1789480043.221983:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897344 00000100:00100000:2.0:1789480043.221986:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897344 00000100:00100000:2.0:1789480043.222009:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789480043.222017:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527897600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.222097:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527897600:12345-0@lo:400:kworker.0 Request processed in 80us (15417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.222103:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789480043.222117:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789480043.222122:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527897344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.222154:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527897344:12345-0@lo:400:kworker.0 Request processed in 31us (15104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.222170:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:2.0:1789480043.223136:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e90e00 x1876405527898240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480043.223154:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527898240:0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.223169:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527898752:0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.223181:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527897600:0@lo:400:kworker.0 00010000:00080000:2.0:1789480043.223310:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e90700 x1876405527898112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480043.223321:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527898112:0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.223337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527898624:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.223497:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527898496:0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.223609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897984 00000100:00100000:2.0:1789480043.223615:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897984 00000100:00100000:2.0:1789480043.223654:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789480043.223662:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527897984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480043.223710:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527897984:12345-0@lo:400:kworker.0 Request processed in 48us (12207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.223716:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:2.0:1789480043.223734:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480043.223786:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.223823:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527897472:0@lo:400:kworker.0 00010000:00080000:0.0:1789480043.223833:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e91c00 x1876405527897984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480043.223841:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527897984:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.223850:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480043.223856:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527898880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480043.223878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.223904:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898496 00000100:00100000:0.0:1789480043.223908:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898496 00000100:00100000:0.0:1789480043.223931:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789480043.223936:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527898496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.223965:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527898496:12345-0@lo:400:kworker.0 Request processed in 28us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480043.223970:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:0.0:1789480043.223990:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789480043.224005:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e93480 x1876405527898496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480043.224013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527898496:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224027:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.224044:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527898368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224062:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480043.224079:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527897344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527897856 00000100:00100000:0.0:1789480043.224095:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527897856 00000100:00100000:0.0:1789480043.224112:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898368 00000100:00100000:0.0:1789480043.224115:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898368 00000100:00100000:0.0:1789480043.224126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789480043.224130:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527897856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224160:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527897856:12345-0@lo:400:kworker.0 Request processed in 29us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480043.224165:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789480043.224176:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789480043.224181:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527898368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224805:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527898368:12345-0@lo:400:kworker.0 Request processed in 622us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480043.224813:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00080000:0.0:1789480043.224829:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480043.224847:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527897856:0@lo:400:kworker.0 00000100:00100000:0.0:1789480043.224856:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527898368:0@lo:400:kworker.0 00000100:00100000:1.0:1789480043.233559:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527898880 00000100:00100000:1.0:1789480043.233571:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527898880 00000100:00100000:1.0:1789480043.233976:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789480043.233988:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527898880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480043.234022:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789480043.234100:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527898880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (10220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480043.234107:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789480043.235085:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527898880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480043.412575:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.412797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879168 00000100:00100000:2.0:1789480043.412813:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879168 00000100:00100000:2.0:1789480043.412895:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 349 00000100:00100000:2.0:1789480043.412909:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:6182:x1876405507879168:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480043.412945:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480043.412988:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d4e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2aa7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.413023:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d4e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa7 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.413038:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d4e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa7 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.413048:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0000, rc 0) 00000100:00100000:2.0:1789480043.413133:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879168:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 226us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.413154:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 349 00000100:00100000:2.0:1789480043.417360:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480043.417438:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879296 00000100:00100000:1.0:1789480043.417448:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879296 00000100:00100000:1.0:1789480043.417506:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 350 00000100:00100000:1.0:1789480043.417516:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879296:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480043.417673:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879296:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 158us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480043.417682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 350 00000100:00100000:1.0:1789480043.423447:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.423566:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879424 00000100:00100000:2.0:1789480043.423579:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879424 00000100:00100000:2.0:1789480043.423637:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 351 00000100:00100000:2.0:1789480043.423647:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879424:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480043.424527:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879424:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 878us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.424538:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 351 00000100:00100000:0.0:1789480043.430350:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.431287:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879552 00000100:00100000:2.0:1789480043.431297:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879552 00000100:00100000:2.0:1789480043.431356:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 352 00000100:00100000:2.0:1789480043.431365:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:10809:x1876405507879552:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480043.431636:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:10809:x1876405507879552:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 271us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.431653:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 352 00000100:00100000:0.0:1789480043.439997:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.440595:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879680 00000100:00100000:2.0:1789480043.440605:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879680 00000100:00100000:2.0:1789480043.440667:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 353 00000100:00100000:2.0:1789480043.440677:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:10809:x1876405507879680:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480043.440818:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:10809:x1876405507879680:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 142us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.440919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 353 00000100:00100000:3.0:1789480043.443683:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.443999:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879808 00000100:00100000:2.0:1789480043.444008:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879808 00000100:00100000:2.0:1789480043.445023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 354 00000100:00100000:2.0:1789480043.447250:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:6182:x1876405507879808:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480043.447275:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480043.447296:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d4e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2aae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.447325:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d4e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aae expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.447337:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d4e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aae expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480043.447347:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0800, rc 0) 00000100:00100000:2.0:1789480043.447430:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507879808:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 2395us (3753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.447438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 354 00000100:00100000:0.0:1789480043.451368:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.452368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507879936 00000100:00100000:2.0:1789480043.452380:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507879936 00000100:00100000:2.0:1789480043.452501:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 355 00000100:00100000:2.0:1789480043.452512:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507879936:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480043.452658:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507879936:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 148us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.452666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 355 00000100:00100000:1.0:1789480043.458557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.458643:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880064 00000100:00100000:2.0:1789480043.458651:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880064 00000100:00100000:2.0:1789480043.458703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 356 00000100:00100000:2.0:1789480043.458712:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507880064:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480043.459480:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:6182:x1876405507880064:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 766us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.459489:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 356 00000100:00100000:0.0:1789480043.464032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.465262:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880192 00000100:00100000:2.0:1789480043.465281:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880192 00000100:00100000:2.0:1789480043.465367:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 357 00000100:00100000:2.0:1789480043.465380:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:10812:x1876405507880192:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480043.465594:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:10812:x1876405507880192:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 216us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.465602:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 357 00000100:00100000:0.0:1789480043.471746:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480043.473022:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880320 00000100:00100000:2.0:1789480043.473040:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880320 00000100:00100000:2.0:1789480043.473131:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 358 00000100:00100000:2.0:1789480043.473155:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:10812:x1876405507880320:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480043.473493:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:10812:x1876405507880320:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 351us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480043.473502:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 358 00000100:00100000:2.0:1789480043.716524:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480043.716557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527899008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480043.716650:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480043.716933:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527899136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480043.716969:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480043.717106:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899008 00000100:00100000:2.0:1789480043.717116:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899008 00000100:00100000:2.0:1789480043.718579:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899136 00000100:00100000:2.0:1789480043.718598:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899136 00000100:00100000:3.0:1789480043.721641:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789480043.721675:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527899008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480043.721726:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480043.721852:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527899008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 196us (5202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.721860:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789480043.721888:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789480043.721894:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527899136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480043.721906:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480043.721956:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527899136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (4986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480043.721962:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789480043.722031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527899136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480043.722277:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527899008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789480043.847695:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480044.101064:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480044.101071:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8800 from 7 10000000:01000000:3.0:1789480044.101075:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480044.101117:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480044.101146:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480044.101158:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480044.101182:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480044.101313:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480044.101371:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987901c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.103414:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899264 00000100:00100000:2.0:1789480044.103434:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899264 00000100:00100000:2.0:1789480044.103529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789480044.103542:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+20:6517:x1876405527899264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480044.103564:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480044.103590:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d4f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d4f0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.103627:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d4f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d4f0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.103639:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d4f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d4f0 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.103650:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1c00, rc 0) 00000100:00100000:2.0:1789480044.103751:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.103758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789480044.104362:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480044.104397:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480044.104409:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480044.104510:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480044.104557:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480044.104604:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987901c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480044.104677:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899392 00000100:00100000:1.0:1789480044.104684:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899392 00000100:00100000:1.0:1789480044.104729:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1789480044.104749:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.104886:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480044.104893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789480044.105542:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480044.105599:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480044.105657:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480044.105695:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987901c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480044.105757:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899520 00000100:00100000:1.0:1789480044.105763:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899520 00000100:00100000:1.0:1789480044.105809:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1789480044.105819:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.106376:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 557us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480044.106397:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789480044.113588:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.114585:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698769a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13800:1876405527899648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480044.114693:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.114786:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.116253:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899648 00000100:00100000:2.0:1789480044.116269:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899648 00000100:00100000:2.0:1789480044.116358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1789480044.116370:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:13800:x1876405527899648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.116789:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:13800:x1876405527899648:12345-0@lo:502:llog_process_th.0 Request processed in 420us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.116797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789480044.116946:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698769a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13800:1876405527899648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480044.116987:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480044.116998:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480044.117000:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480044.117008:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6abb3b8800 00000020:00000080:0.0:1789480044.117011:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480044.117090:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480044.117094:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480044.117095:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480044.117097:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480044.117099:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480044.117101:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789480044.117104:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6abb3b8800 00000020:00000080:0.0:1789480044.117105:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789480044.117152:0:13800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13800:1876405527899776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480044.117226:0:13800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480044.117267:0:13800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.121045:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899776 00000100:00100000:2.0:1789480044.121066:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899776 00000100:00100000:2.0:1789480044.121142:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1789480044.121154:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:13800:x1876405527899776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.121409:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+21:13800:x1876405527899776:12345-0@lo:502:llog_process_th.0 Request processed in 256us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.121417:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789480044.122045:0:13800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13800:1876405527899776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480044.122090:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480044.122100:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480044.122103:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789480044.122118:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789480044.122509:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789480044.122536:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480044.122548:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.122571:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480044.122583:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789480044.122586:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6abb3b8000 from 7 10000000:01000000:2.0:1789480044.122589:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480044.122629:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.122638:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.122656:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480044.122683:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.122743:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480044.122792:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480044.123000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527899904 00000100:00100000:0.0:1789480044.123008:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527899904 00000100:00100000:0.0:1789480044.123064:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789480044.123073:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+21:6517:x1876405527899904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480044.123087:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480044.123103:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243d505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d4fe expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480044.123129:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243d505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d4fe expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480044.123140:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243d505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d4fe expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480044.123150:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da200, rc 0) 00000100:00100000:0.0:1789480044.123225:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527899904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.123232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1789480044.123324:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527899904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480044.123340:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.123350:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480044.123427:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.123459:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.123488:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480044.123769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900032 00000100:00100000:0.0:1789480044.123775:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900032 00000100:00100000:0.0:1789480044.123812:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1789480044.123831:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527900032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480044.125780:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527900032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1950us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.125797:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1789480044.125834:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.125987:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.126052:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480044.126095:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480044.127131:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900160 00000100:00100000:1.0:1789480044.127144:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900160 00000100:00100000:1.0:1789480044.127233:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1789480044.127244:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527900160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.127414:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527900160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480044.127422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789480044.132659:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.146311:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13803:1876405527900288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.146449:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480044.147158:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900288 00000100:00100000:3.0:1789480044.147175:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900288 00000100:00100000:3.0:1789480044.147252:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789480044.147264:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:13803:x1876405527900288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.147303:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480044.147442:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+22:13803:x1876405527900288:12345-0@lo:502:llog_process_th.0 Request processed in 180us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480044.147451:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1789480044.147627:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13803:1876405527900288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480044.147745:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480044.147756:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480044.147758:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789480044.147766:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6abb3b8000 00000020:00000080:2.0:1789480044.147769:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789480044.147841:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480044.147845:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480044.147847:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789480044.147849:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789480044.147851:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480044.147858:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789480044.147863:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6abb3b8000 00000020:00000080:2.0:1789480044.147865:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789480044.147912:0:13803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13803:1876405527900416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.147971:0:13803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480044.148008:0:13803:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480044.148861:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900416 00000100:00100000:3.0:1789480044.148872:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900416 00000100:00100000:3.0:1789480044.148921:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789480044.148932:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:13803:x1876405527900416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480044.149071:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+22:13803:x1876405527900416:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480044.149079:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789480044.150372:0:13803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13803:1876405527900416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789480044.150431:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789480044.150441:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789480044.150443:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789480044.150448:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789480044.151843:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1789480044.151905:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480044.151919:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480044.151941:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480044.152856:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789480044.154703:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480044.154708:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a866ce000 from 7 10000000:01000000:1.0:1789480044.154712:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480044.154768:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.154778:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.154791:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480044.154822:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.154905:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.154956:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.155447:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900544 00000100:00100000:2.0:1789480044.155457:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900544 00000100:00100000:2.0:1789480044.155529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789480044.155540:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+22:6517:x1876405527900544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480044.155556:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480044.155574:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d50c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.155604:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d50c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.155616:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d50c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.155626:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1600, rc 0) 00000100:00100000:2.0:1789480044.155684:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527900544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.155704:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789480044.155815:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987699880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480044.155832:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480044.155843:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480044.155920:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480044.155949:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480044.155981:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.156094:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900672 00000100:00100000:2.0:1789480044.156099:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900672 00000100:00100000:2.0:1789480044.156132:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789480044.156140:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527900672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.156291:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aa3158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527900672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.156298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789480044.158012:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.158076:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.158154:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.158520:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.158670:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900800 00000100:00100000:2.0:1789480044.158679:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900800 00000100:00100000:2.0:1789480044.158774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789480044.158785:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527900800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.158934:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527900800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.158943:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789480044.159020:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527900800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.164111:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13805:1876405527900928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.164256:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480044.164307:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480044.164454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527900928 00000100:00100000:0.0:1789480044.164464:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527900928 00000100:00100000:0.0:1789480044.164575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789480044.164588:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:13805:x1876405527900928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480044.164744:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+23:13805:x1876405527900928:12345-0@lo:502:llog_process_th.0 Request processed in 159us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.164753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789480044.169654:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13805:1876405527900928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480044.169715:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480044.169732:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480044.169734:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480044.169745:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6a866ce000 00000020:00000080:3.0:1789480044.169748:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480044.169829:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480044.169833:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480044.169835:0:13805:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480044.169837:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480044.169840:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480044.169841:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789480044.169845:0:13805:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6a866ce000 00000020:00000080:3.0:1789480044.169846:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789480044.170164:0:13805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13805:1876405527901056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480044.170354:0:13805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480044.170417:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901056 00000100:00100000:3.0:1789480044.170425:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901056 00000100:00100000:3.0:1789480044.170488:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789480044.170499:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:13805:x1876405527901056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480044.170702:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+23:13805:x1876405527901056:12345-0@lo:502:llog_process_th.0 Request processed in 203us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480044.170709:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789480044.170761:0:13805:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987901480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480044.170777:0:13805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13805:1876405527901056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480044.170800:0:13805:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480044.170806:0:13805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480044.170808:0:13805:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789480044.170813:0:13805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789480044.180130:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1789480044.180181:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480044.184451:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.184468:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480044.184484:0:6517:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480044.184487:0:6517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6a83cfb000 from 7 10000000:01000000:1.0:1789480044.184490:0:6517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480044.184542:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.184551:0:6517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.184563:0:6517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480044.184595:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.184683:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.184736:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.185023:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901184 00000100:00100000:2.0:1789480044.185035:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901184 00000100:00100000:2.0:1789480044.185098:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789480044.185109:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+23:6517:x1876405527901184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480044.185126:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480044.185141:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d521 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243d51a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.185205:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243d51a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.185218:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d521 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243d51a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.185228:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:2.0:1789480044.185282:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8beb4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527901184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.185289:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789480044.187892:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480044.187937:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480044.187951:0:6517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480044.188068:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.188156:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.188223:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.188640:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901312 00000100:00100000:2.0:1789480044.188650:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901312 00000100:00100000:2.0:1789480044.188710:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789480044.188721:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527901312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480044.188869:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac0432450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527901312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.188876:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789480044.190323:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.190406:0:6517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.190478:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.190527:0:6517:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480044.190611:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901440 00000100:00100000:0.0:1789480044.190619:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901440 00000100:00100000:0.0:1789480044.190677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789480044.190686:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527901440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480044.190817:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86a93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:6517:x1876405527901440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.190832:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1789480044.191236:0:6517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6a679393-20ef-489d-b204-2797ec519e97:6517:1876405527901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480044.192251:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13807:1876405527901568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480044.192327:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.192374:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789480044.192413:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901568 00000100:00100000:2.0:1789480044.192422:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901568 00000100:00100000:2.0:1789480044.192472:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789480044.192484:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:13807:x1876405527901568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480044.192733:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:13807:x1876405527901568:12345-0@lo:502:llog_process_th.0 Request processed in 252us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480044.192742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1789480044.192870:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13807:1876405527901568:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480044.192909:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480044.192929:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480044.192932:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480044.192940:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6a83cfb000 00000020:00000080:1.0:1789480044.192943:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789480044.193016:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480044.193178:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480044.193180:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480044.193184:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480044.193188:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480044.193211:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789480044.193217:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6a83cfb000 00000020:00000080:1.0:1789480044.193219:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789480044.193263:0:13807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13807:1876405527901696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480044.193303:0:13807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480044.193341:0:13807:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480044.193645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901696 00000100:00100000:0.0:1789480044.193653:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901696 00000100:00100000:0.0:1789480044.193693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789480044.193703:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:13807:x1876405527901696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480044.193808:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:13807:x1876405527901696:12345-0@lo:502:llog_process_th.0 Request processed in 107us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480044.193815:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789480044.194119:0:13807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6a679393-20ef-489d-b204-2797ec519e97:13807:1876405527901696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480044.194147:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480044.194153:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480044.194155:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789480044.194159:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789480044.194637:0:6517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1789480044.194673:0:6517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480044.194690:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480044.194704:0:6517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480044.198520:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789480044.868430:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480045.189370:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789480045.257150:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789480045.764444:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480045.764444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480045.764473:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527901824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480045.764473:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527901952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480045.765062:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480045.765290:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901952 00000100:00100000:3.0:1789480045.765301:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901952 00000100:00100000:3.0:1789480045.765388:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789480045.765400:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527901952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480045.765439:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480045.765497:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527901952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480045.765506:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1789480045.765570:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480045.765888:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987fadc00 x1876405527901952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480045.765913:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527901952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480045.773295:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480045.773661:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527901824 00000100:00100000:0.0:1789480045.773673:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527901824 00000100:00100000:0.0:1789480045.773759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789480045.773771:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527901824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480045.773805:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480045.773880:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527901824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480045.773888:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:2.0:1789480045.774479:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff0380 x1876405527901824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480045.774506:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527901824:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789480045.774760:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789480045.894323:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480046.278676:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480046.278705:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527902080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480046.278791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480046.279565:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902080 00000100:00100000:3.0:1789480046.279579:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902080 00000100:00100000:3.0:1789480046.279650:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789480046.279663:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527902080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480046.279729:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480046.279813:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527902080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480046.279821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789480046.280017:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527902080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480046.434351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480046.434408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480046.434446:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480046.434479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480046.434502:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480046.434526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480046.434556:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880448 00000100:00100000:1.0:1789480046.434556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880576 00000100:00100000:1.0:1789480046.434567:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880576 00000100:00100000:3.0:1789480046.434622:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880448 00000100:00100000:1.0:1789480046.434629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880704 00000100:00100000:1.0:1789480046.434634:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880704 00000100:00100000:1.0:1789480046.434657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881088 00000100:00100000:3.0:1789480046.434659:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:1.0:1789480046.434661:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881088 00000100:00100000:3.0:1789480046.434671:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507880448:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480046.434679:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880960 00000100:00100000:1.0:1789480046.434683:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880960 00000100:00100000:1.0:1789480046.434701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 263 00000100:00100000:1.0:1789480046.434710:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507880576:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480046.434732:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a88c78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507880448:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480046.434740:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:1.0:1789480046.434749:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507880576:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480046.434773:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 264 00000100:00100000:3.0:1789480046.434780:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507880704:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480046.434803:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507880704:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480046.434835:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507880832 00000100:00100000:0.0:1789480046.434840:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507880832 00000100:00100000:0.0:1789480046.434884:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:0.0:1789480046.434903:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507880832:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480046.434939:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507880832:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 48us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480046.434955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:1.0:1789480046.435133:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 263 00000100:00100000:1.0:1789480046.435149:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 265 00000100:00100000:1.0:1789480046.435156:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507881088:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480046.435210:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507881088:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480046.435217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 265 00000100:00100000:1.0:1789480046.435229:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 266 00000100:00100000:1.0:1789480046.435235:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507880960:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480046.435260:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507880960:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480046.435266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 266 00000100:00080000:1.0:1789480046.435290:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480046.435295:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480046.435297:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480046.437244:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 264 00010000:00010000:0.0:1789480046.916758:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789480047.820252:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:2.0:1789480047.940726:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480048.326007:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527902464:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.326030:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527902208:0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.326141:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527902336:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.326511:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480048.326575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527902720:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.326600:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480048.326620:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903232:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.326640:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480048.326658:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903744:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.326676:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480048.326936:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902720 00000100:00100000:3.0:1789480048.326944:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902720 00000100:00100000:3.0:1789480048.326990:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789480048.326999:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527902720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327050:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527902720:12345-0@lo:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327056:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789480048.327090:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903232 00000100:00100000:3.0:1789480048.327094:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903232 00000100:00100000:3.0:1789480048.327135:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903744 00000100:00100000:3.0:1789480048.327138:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903744 00000100:00100000:3.0:1789480048.327157:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480048.327163:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327216:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903232:12345-0@lo:400:kworker.0 Request processed in 53us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327223:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480048.327234:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789480048.327240:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327268:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903744:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327273:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789480048.327292:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902208 00000100:00100000:3.0:1789480048.327296:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902208 00000100:00100000:3.0:1789480048.327319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789480048.327325:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527902208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327378:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527902208:12345-0@lo:400:kworker.0 Request processed in 54us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327384:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789480048.327440:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527902592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327466:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480048.327486:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527903104:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327507:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480048.327524:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527903616:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327542:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480048.327568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903104 00000100:00100000:3.0:1789480048.327577:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903104 00000100:00100000:3.0:1789480048.327596:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903616 00000100:00100000:3.0:1789480048.327598:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903616 00000100:00100000:3.0:1789480048.327610:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789480048.327616:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527903104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327649:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527903104:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327655:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789480048.327668:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789480048.327674:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527903616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327715:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527903616:12345-0@lo:400:kworker.0 Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327721:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1789480048.327755:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698792a680 x1876405527903104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480048.327769:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527903104:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327780:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527903616:0@lo:400:kworker.0 00000100:00080000:3.0:1789480048.327815:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480048.327819:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480048.327840:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902592 00000100:00100000:3.0:1789480048.327844:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902592 00000100:00100000:3.0:1789480048.327869:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789480048.327874:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527902592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.327910:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527902592:12345-0@lo:400:kworker.0 Request processed in 34us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.327915:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789480048.327948:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527902592:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.328041:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789480048.328046:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6987d72680, transno 4294967301 00000100:00100000:0.0:1789480048.328063:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903744:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.328081:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527902208:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.328089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527902720:0@lo:400:kworker.0 00010000:00080000:0.0:1789480048.328098:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698792ad80 x1876405527903232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480048.328107:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903232:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.328117:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480048.328122:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480048.328145:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480048.328172:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903872 00000100:00100000:0.0:1789480048.328181:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903872 00000100:00100000:0.0:1789480048.328226:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789480048.328232:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480048.328255:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480048.328291:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527903872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480048.328297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789480048.328326:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527903872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480048.330131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480048.330218:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527902976:0@lo:400:kworker.0 00000100:00100000:2.0:1789480048.330279:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480048.330303:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527903488:0@lo:400:kworker.0 00000100:00100000:2.0:1789480048.330341:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480048.330411:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902976 00000100:00100000:2.0:1789480048.330420:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902976 00000100:00100000:1.0:1789480048.330471:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480048.330509:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527902848:0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.330541:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480048.330629:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527903360:0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.330652:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480048.330968:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903488 00000100:00100000:1.0:1789480048.330975:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903488 00000100:00100000:1.0:1789480048.331014:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902336 00000100:00100000:1.0:1789480048.331028:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902336 00000100:00100000:1.0:1789480048.331044:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902848 00000100:00100000:1.0:1789480048.331045:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902848 00000100:00100000:1.0:1789480048.331056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527903360 00000100:00100000:1.0:1789480048.331058:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527903360 00000100:00100000:1.0:1789480048.331074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789480048.331080:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527903488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.331132:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527903488:12345-0@lo:400:kworker.0 Request processed in 51us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480048.331138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789480048.331152:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789480048.331158:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527902336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.331211:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527902336:12345-0@lo:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480048.331217:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789480048.331228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789480048.331234:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527902848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.331260:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527902848:12345-0@lo:400:kworker.0 Request processed in 27us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480048.331266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789480048.331280:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789480048.331286:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527903360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480048.331316:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527903360:12345-0@lo:400:kworker.0 Request processed in 30us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480048.331323:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789480048.331376:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789480048.331387:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527902976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480048.331457:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527902976:12345-0@lo:400:kworker.0 Request processed in 72us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480048.331463:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00080000:2.0:1789480048.331512:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698792b800 x1876405527902976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480048.331527:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527902976:0@lo:400:kworker.0 00010000:00080000:2.0:1789480048.331540:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698792a300 x1876405527903488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480048.331549:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527903488:0@lo:400:kworker.0 00000100:00080000:2.0:1789480048.331607:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480048.331612:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480048.331797:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527902336:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.331812:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527902848:0@lo:400:kworker.0 00000100:00100000:0.0:1789480048.331824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527903360:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.332760:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527902464 00000100:00100000:3.0:1789480048.332772:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527902464 00000100:00100000:3.0:1789480048.332836:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789480048.332846:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527902464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.332942:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527902464:12345-0@lo:400:kworker.0 Request processed in 98us (2820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480048.332950:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789480048.333255:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527902464:0@lo:400:kworker.0 00000100:00100000:3.0:1789480048.836789:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527904000:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480048.836901:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480048.837098:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904000 00000100:00100000:2.0:1789480048.837110:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904000 00000100:00100000:2.0:1789480048.837180:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789480048.837226:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527904000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480048.837264:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480048.837364:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527904000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 166us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480048.837372:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789480048.837429:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527904000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480048.838774:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527904128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480048.838874:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480048.839083:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904128 00000100:00100000:0.0:1789480048.839092:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904128 00000100:00100000:0.0:1789480048.839145:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789480048.839155:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527904128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480048.839178:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480048.839299:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527904128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480048.839306:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789480048.839893:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527904128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789480048.965605:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480049.988817:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480050.884726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527904256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480050.884795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480050.884942:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904256 00000100:00100000:2.0:1789480050.884950:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904256 00000100:00100000:2.0:1789480050.885019:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789480050.885029:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527904256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480050.885058:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480050.885104:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527904256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480050.885124:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789480050.885274:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527904384:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789480050.885342:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480050.885386:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789480050.885399:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff3480 x1876405527904256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480050.885452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527904256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480050.885967:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904384 00000100:00100000:3.0:1789480050.885977:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904384 00000100:00100000:3.0:1789480050.886054:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789480050.886065:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527904384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480050.886090:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480050.886251:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527904384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480050.886259:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789480050.890077:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480050.899244:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d71880 x1876405527904384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480050.899280:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527904384:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789480051.012823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480051.397140:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527904512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480051.397262:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480051.397408:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904512 00000100:00100000:0.0:1789480051.397419:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904512 00000100:00100000:0.0:1789480051.397500:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789480051.397513:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527904512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480051.397557:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789480051.407276:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527904512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9742us (9990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.407295:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789480051.407707:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527904512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480051.540391:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480051.540458:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480051.540533:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480051.540560:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480051.540584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480051.540627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480051.540832:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881600 00000100:00100000:3.0:1789480051.540844:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881600 00000100:00100000:3.0:1789480051.540938:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:3.0:1789480051.540949:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881600:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480051.541036:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881600:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 90us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480051.541044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00080000:1.0:1789480051.541352:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480051.541418:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881472 00000100:00100000:2.0:1789480051.541424:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881472 00000100:00100000:2.0:1789480051.541475:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881728 00000100:00100000:2.0:1789480051.541478:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881728 00000100:00100000:2.0:1789480051.541504:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881344 00000100:00100000:2.0:1789480051.541507:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881344 00000100:00100000:2.0:1789480051.541520:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881856 00000100:00100000:2.0:1789480051.541523:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881856 00000100:00100000:2.0:1789480051.541538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 273 00000100:00100000:2.0:1789480051.541545:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881472:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480051.541582:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881472:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480051.541589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 273 00000100:00100000:2.0:1789480051.541614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:2.0:1789480051.541621:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507881728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480051.541665:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507881728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 45us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480051.541671:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 274 00000100:00100000:2.0:1789480051.541683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 275 00000100:00100000:2.0:1789480051.541688:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881344:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480051.541710:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507881344:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480051.541715:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 275 00000100:00100000:2.0:1789480051.541725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 276 00000100:00100000:2.0:1789480051.541731:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507881856:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480051.541752:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507881856:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480051.541757:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 276 00000100:00080000:1.0:1789480051.542002:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480051.542007:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480051.542741:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881216 00000100:00100000:0.0:1789480051.542753:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881216 00000100:00100000:0.0:1789480051.542869:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 381 00000100:00100000:0.0:1789480051.542880:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507881216:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480051.542931:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507881216:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 54us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480051.542939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 381 00010000:00010000:2.0:1789480052.036775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480053.063786:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480053.445145:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480053.445181:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527904640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480053.445272:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480053.445400:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904640 00000100:00100000:0.0:1789480053.445485:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904640 00000100:00100000:0.0:1789480053.446029:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789480053.446040:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527904640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480053.446074:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480053.446124:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527904640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480053.446141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789480053.446258:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527905024:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.446304:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446715:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527904768:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446767:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446800:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527905280:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446824:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446842:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527905792:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446861:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446882:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789480053.446888:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527904896:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446909:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446940:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527905408:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.446978:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527905920:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.446996:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.447022:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905280 00000100:00100000:2.0:1789480053.447028:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905280 00000100:00100000:2.0:1789480053.447067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905792 00000100:00100000:2.0:1789480053.447070:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905792 00000100:00100000:2.0:1789480053.447083:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904896 00000100:00100000:2.0:1789480053.447085:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904896 00000100:00100000:2.0:1789480053.447094:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905408 00000100:00100000:2.0:1789480053.447096:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905408 00000100:00100000:2.0:1789480053.447106:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905920 00000100:00100000:2.0:1789480053.447108:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905920 00000100:00100000:2.0:1789480053.447120:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789480053.447127:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527905280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.447168:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527905280:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480053.447175:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789480053.447219:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789480053.447226:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527905792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.447253:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527905792:12345-0@lo:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480053.447259:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789480053.447269:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789480053.447274:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527904896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.447298:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527904896:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480053.447313:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789480053.447324:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789480053.447329:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527905408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.447382:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527905408:12345-0@lo:400:kworker.0 Request processed in 52us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480053.447387:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789480053.447397:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789480053.447402:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527905920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.447513:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527905920:12345-0@lo:400:kworker.0 Request processed in 110us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480053.447519:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789480053.447989:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527904896:0@lo:400:kworker.0 00010000:00080000:2.0:1789480053.448004:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a9f4bbb80 x1876405527905408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480053.448014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527905408:0@lo:400:kworker.0 00010000:00080000:2.0:1789480053.448023:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a9f4bb800 x1876405527905920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480053.448031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527905920:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.448040:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527905280:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.448048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527905792:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456184:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527905536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480053.456276:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527906048:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456296:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480053.456354:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527904640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480053.456395:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789480053.456403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527905152:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456444:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480053.456463:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527905664:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456484:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480053.456501:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527906176:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456519:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480053.456549:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905536 00000100:00100000:1.0:1789480053.456555:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905536 00000100:00100000:1.0:1789480053.456590:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906048 00000100:00100000:1.0:1789480053.456593:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906048 00000100:00100000:1.0:1789480053.456604:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905664 00000100:00100000:1.0:1789480053.456606:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905664 00000100:00100000:1.0:1789480053.456616:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906176 00000100:00100000:1.0:1789480053.456618:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906176 00000100:00100000:1.0:1789480053.456632:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789480053.456640:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527905536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456691:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527905536:12345-0@lo:400:kworker.0 Request processed in 51us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480053.456698:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789480053.456714:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789480053.456732:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527906048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456761:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527906048:12345-0@lo:400:kworker.0 Request processed in 42us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480053.456768:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789480053.456778:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789480053.456783:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527905664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456816:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527905664:12345-0@lo:400:kworker.0 Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480053.456822:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789480053.456832:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789480053.456838:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527906176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456861:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527906176:12345-0@lo:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480053.456866:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1789480053.456890:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480053.456894:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480053.456896:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480053.456898:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480053.456907:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905152 00000100:00100000:1.0:1789480053.456910:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905152 00000100:00100000:1.0:1789480053.456933:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789480053.456939:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527905152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.456977:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527905152:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480053.456983:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789480053.457011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527905152:0@lo:400:kworker.0 00010000:00080000:1.0:1789480053.457023:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a9f4bb480 x1876405527905664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480053.457033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527905664:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.457041:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527906176:0@lo:400:kworker.0 00010000:00080000:1.0:1789480053.457050:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a9f4b8700 x1876405527905536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480053.457064:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527905536:0@lo:400:kworker.0 00000100:00100000:1.0:1789480053.457074:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527906048:0@lo:400:kworker.0 00000100:00100000:3.0:1789480053.457946:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527905024 00000100:00100000:3.0:1789480053.457955:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527905024 00000100:00100000:3.0:1789480053.457990:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789480053.457997:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527905024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480053.458056:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527905024:12345-0@lo:400:kworker.0 Request processed in 59us (11752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480053.458063:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789480053.458086:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527904768 00000100:00100000:3.0:1789480053.458090:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527904768 00000100:00100000:3.0:1789480053.458113:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789480053.458120:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527904768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480053.458156:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527904768:12345-0@lo:400:kworker.0 Request processed in 36us (11388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480053.458162:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789480053.458231:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527905024:0@lo:400:kworker.0 00000100:00100000:3.0:1789480053.458264:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527904768:0@lo:400:kworker.0 00000100:00100000:2.0:1789480053.957582:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789480053.957603:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527906304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480053.957676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480053.957743:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527906432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480053.957765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480053.957868:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906304 00000100:00100000:3.0:1789480053.957881:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906304 00000100:00100000:0.0:1789480053.957903:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906432 00000100:00100000:0.0:1789480053.957907:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906432 00000100:00100000:3.0:1789480053.957928:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789480053.957936:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527906304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480053.957964:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480053.958143:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527906304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480053.958423:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789480053.958435:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527906432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789480053.958447:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480053.958480:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527906432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480053.958487:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789480053.960291:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527906304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480053.960342:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527906432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480053.960552:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00010000:2.0:1789480054.084399:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480055.108288:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480055.429147:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789480055.493566:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480056.004521:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527906560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480056.004590:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480056.004640:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527906688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480056.004669:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480056.016536:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906560 00000100:00100000:0.0:1789480056.016551:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906560 00000100:00100000:0.0:1789480056.016625:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906688 00000100:00100000:0.0:1789480056.016629:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906688 00000100:00100000:0.0:1789480056.016652:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789480056.016661:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527906560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480056.016692:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480056.017843:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1789480056.018835:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480056.019800:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527906560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3135us (15205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.019812:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1789480056.020067:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987d71500 x1876405527906560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480056.020114:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527906560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480056.027067:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527906688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480056.027102:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480056.027211:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527906688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9356us (22541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480056.027220:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1789480056.029041:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987ff0a80 x1876405527906688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480056.029068:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527906688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789480056.134265:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480056.516648:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480056.516671:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527906816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480056.516739:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480056.516868:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906816 00000100:00100000:3.0:1789480056.516876:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906816 00000100:00100000:3.0:1789480056.516928:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789480056.516939:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527906816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480056.516979:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480056.517048:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527906816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480056.517054:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789480056.517418:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527906816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480056.676149:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480056.676280:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480056.676332:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480056.677054:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882240 00000100:00100000:2.0:1789480056.677066:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882240 00000100:00100000:2.0:1789480056.677131:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882112 00000100:00100000:2.0:1789480056.677134:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882112 00000100:00100000:2.0:1789480056.677156:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00100000:2.0:1789480056.677166:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882240:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480056.677257:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882240:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 93us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480056.677266:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 283 00000100:00100000:2.0:1789480056.677282:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00100000:2.0:1789480056.677288:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882112:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480056.677312:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882112:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480056.677336:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 284 00000100:00080000:1.0:1789480056.678870:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480056.678880:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480056.681590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507881984 00000100:00100000:0.0:1789480056.681607:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507881984 00000100:00100000:0.0:1789480056.681694:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 383 00000100:00100000:0.0:1789480056.681704:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507881984:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480056.681802:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a897dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507881984:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (5662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480056.681809:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 383 00000100:00100000:1.0:1789480056.688341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480056.688488:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882368 00000100:00100000:3.0:1789480056.688497:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882368 00000100:00100000:3.0:1789480056.688568:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:3.0:1789480056.688579:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2398:x1876405507882368:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1789480056.688606:0:8493:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d448 00000100:00080000:3.0:1789480056.688614:0:8493:0:(import.c:65:import_set_state_nolock()) ffff8a6a866c8800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480056.688664:0:8493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:2.0:1789480056.688690:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480056.688957:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+2:2398:x1876405507882368:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 379us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480056.688980:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00080000:1.0:1789480056.690525:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480056.696806:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480056.696935:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480056.697036:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882496 00000100:00100000:2.0:1789480056.697066:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882496 00000100:00100000:2.0:1789480056.697152:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882624 00000100:00100000:2.0:1789480056.697156:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882624 00000100:00100000:2.0:1789480056.697183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 285 00000100:00100000:2.0:1789480056.697222:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507882496:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480056.697304:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507882496:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 110us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480056.697312:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 285 00000100:00080000:1.0:1789480056.697469:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480056.697476:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480056.700934:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 286 00000100:00100000:3.0:1789480056.700967:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507882624:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480056.701402:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507882624:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 451us (4465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480056.701412:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 286 00010000:00010000:2.0:1789480057.156720:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480058.180414:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480058.565600:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527906944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480058.565617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527907072:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.565700:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480058.565701:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480058.567769:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527907456:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.567948:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480058.568010:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527907200:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.568035:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480058.568056:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480058.568075:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527907328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.568097:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480058.568139:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907456 00000100:00100000:0.0:1789480058.568146:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907456 00000100:00100000:0.0:1789480058.568185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907200 00000100:00100000:0.0:1789480058.568188:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907200 00000100:00100000:0.0:1789480058.568224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789480058.568232:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527907456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.568278:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527907456:12345-0@lo:400:kworker.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480058.568285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789480058.568300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789480058.568317:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527907200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.568349:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527907200:12345-0@lo:400:kworker.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480058.568355:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789480058.568374:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527906944 00000100:00100000:0.0:1789480058.568378:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527906944 00000100:00100000:0.0:1789480058.568398:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907328 00000100:00100000:0.0:1789480058.568401:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907328 00000100:00100000:0.0:1789480058.568412:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480058.568418:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527906944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480058.568571:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480058.568679:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527906944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 187us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480058.568686:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480058.568701:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789480058.568995:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527907328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.569111:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907072 00000100:00100000:3.0:1789480058.569117:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907072 00000100:00100000:3.0:1789480058.569150:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789480058.569157:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527907072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.569224:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a90008850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527907072:12345-0@lo:400:kworker.0 Request processed in 35us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480058.569231:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789480058.569318:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527907328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.569332:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527907200:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.569361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527907456:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.569376:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527906944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480058.569483:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527907328:12345-0@lo:400:kworker.0 Request processed in 326us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480058.569501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789480058.576972:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527907840:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.577044:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480058.577151:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527908352:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.577173:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480058.577234:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789480058.577255:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527907712:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.577286:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480058.577322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527908224:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.577351:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907840 00000100:00100000:3.0:1789480058.577352:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480058.577367:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907840 00000100:00100000:3.0:1789480058.577415:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907712 00000100:00100000:1.0:1789480058.577546:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908352 00000100:00100000:1.0:1789480058.577553:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908352 00000100:00100000:1.0:1789480058.577669:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789480058.577681:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527908352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.577735:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527908352:12345-0@lo:400:kworker.0 Request processed in 57us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.577741:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789480058.577771:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908224 00000100:00100000:1.0:1789480058.577775:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908224 00000100:00100000:1.0:1789480058.577802:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789480058.577808:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527908224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480058.577850:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527907584:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.577902:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907712 00000100:00100000:0.0:1789480058.577928:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480058.577945:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527907840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.578738:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527908352:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.578796:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789480058.578804:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527907712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.583204:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527908224:12345-0@lo:400:kworker.0 Request processed in 5374us (5830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.583231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789480058.583280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527907968:0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.583342:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480058.583367:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527908480:0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.583387:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480058.583419:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907968 00000100:00100000:1.0:1789480058.583845:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907968 00000100:00100000:1.0:1789480058.583883:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908480 00000100:00100000:1.0:1789480058.583886:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908480 00000100:00100000:1.0:1789480058.583901:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789480058.583908:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527907968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.583959:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527907968:12345-0@lo:400:kworker.0 Request processed in 51us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.583965:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789480058.583977:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789480058.583983:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527908480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.584008:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527908480:12345-0@lo:400:kworker.0 Request processed in 26us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.584013:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:1.0:1789480058.584047:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812ab100 x1876405527907968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480058.584060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527907968:0@lo:400:kworker.0 00000100:00100000:2.0:1789480058.584236:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480058.584267:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527908096:0@lo:400:kworker.0 00000100:00100000:2.0:1789480058.584294:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480058.585118:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527908480:0@lo:400:kworker.0 00000100:00080000:1.0:1789480058.585166:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480058.585183:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480058.585185:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480058.585216:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527907584 00000100:00100000:1.0:1789480058.585222:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527907584 00000100:00100000:1.0:1789480058.585255:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908096 00000100:00100000:1.0:1789480058.585258:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908096 00000100:00100000:1.0:1789480058.585274:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789480058.585280:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527907584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.585335:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527907584:12345-0@lo:400:kworker.0 Request processed in 55us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.585341:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789480058.585355:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789480058.585361:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527908096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480058.585387:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527908096:12345-0@lo:400:kworker.0 Request processed in 26us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480058.585393:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1789480058.585406:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480058.585775:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527908096:0@lo:400:kworker.0 00000100:00100000:2.0:1789480058.585786:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527907072:0@lo:400:kworker.0 00000100:00100000:2.0:1789480058.585809:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527907584:0@lo:400:kworker.0 00010000:00080000:1.0:1789480058.587046:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812a9c00 x1876405527908224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480058.587118:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527908224:0@lo:400:kworker.0 00000100:00100000:3.0:1789480058.590475:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527907712:12345-0@lo:400:kworker.0 Request processed in 11664us (13180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480058.590488:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00080000:1.0:1789480058.590587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812a8380 x1876405527907712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480058.590603:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527907712:0@lo:400:kworker.0 00000100:00100000:0.0:1789480058.596061:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527907840:12345-0@lo:400:kworker.0 Request processed in 18108us (19001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480058.596080:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:1.0:1789480058.596792:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812a9180 x1876405527907840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480058.596812:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527907840:0@lo:400:kworker.0 00000100:00100000:1.0:1789480059.077684:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480059.077734:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527908608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480059.077823:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480059.078234:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908608 00000100:00100000:0.0:1789480059.078244:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908608 00000100:00100000:0.0:1789480059.078319:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789480059.078332:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527908608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480059.078368:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480059.078429:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527908608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480059.078436:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789480059.078598:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527908608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480059.088922:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480059.088954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527908736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480059.089042:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480059.089533:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908736 00000100:00100000:2.0:1789480059.089543:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908736 00000100:00100000:2.0:1789480059.089607:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789480059.089619:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527908736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480059.089649:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480059.089939:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527908736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480059.090000:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527908736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 382us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480059.090023:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:2.0:1789480059.204427:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480060.228592:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480061.126238:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480061.126268:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527908864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480061.126375:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480061.126784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908864 00000100:00100000:2.0:1789480061.126794:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908864 00000100:00100000:2.0:1789480061.126870:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789480061.126882:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527908864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480061.126920:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480061.126978:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527908864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.126986:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1789480061.127693:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789480061.127745:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a9f4b9180 x1876405527908864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480061.127770:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527908864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480061.129969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527908992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480061.130061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480061.130186:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527908992 00000100:00100000:2.0:1789480061.130226:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527908992 00000100:00100000:2.0:1789480061.130307:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789480061.130317:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527908992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480061.130345:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789480061.132267:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480061.137182:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527908992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6851us (7106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.137216:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:1.0:1789480061.145126:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987e91c00 x1876405527908992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480061.145165:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527908992:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789480061.260232:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480061.636542:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527909120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480061.636645:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480061.636870:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909120 00000100:00100000:3.0:1789480061.636881:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909120 00000100:00100000:3.0:1789480061.636949:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789480061.636961:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527909120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480061.637003:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789480061.637057:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527909120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480061.637064:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789480061.637235:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527909120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480061.779833:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480061.779884:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480061.779942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480061.779987:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480061.780027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480061.780075:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882752 00000100:00100000:0.0:1789480061.780088:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882752 00000100:00100000:0.0:1789480061.780158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 385 00000100:00100000:0.0:1789480061.780169:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507882752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480061.783709:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507882880 00000100:00100000:2.0:1789480061.783724:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507882880 00000100:00100000:2.0:1789480061.783806:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:2.0:1789480061.783820:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480061.783896:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507882880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 80us (4078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.783903:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 293 00000100:00100000:2.0:1789480061.783946:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883136 00000100:00100000:2.0:1789480061.783951:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883136 00000100:00100000:2.0:1789480061.783969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883008 00000100:00100000:2.0:1789480061.783972:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883008 00000100:00100000:2.0:1789480061.783984:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883264 00000100:00100000:2.0:1789480061.783986:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883264 00000100:00100000:2.0:1789480061.784000:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:2.0:1789480061.784006:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507883136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480061.784034:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507883136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (4150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.784040:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 294 00000100:00100000:2.0:1789480061.784052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:2.0:1789480061.784060:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507883008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480061.784083:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507883008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.784089:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 295 00000100:00100000:2.0:1789480061.784101:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 296 00000100:00100000:2.0:1789480061.784108:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507883264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480061.784145:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507883264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (4117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480061.784151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 296 00000100:00080000:2.0:1789480061.784243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480061.784247:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480061.789555:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507882752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 9370us (9594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480061.789577:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 385 00000001:00100000:1.0:1789480062.159434:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480062.159446:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6a866c8000/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:2.0:1789480062.159940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a866c8000/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-OST0001 00000020:00000080:2.0:1789480062.160017:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6a866c8800 for lustre-OST0001 00010000:00010000:2.0:1789480062.276413:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480063.301378:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480063.685267:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480063.685307:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527909248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480063.685407:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.685967:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909248 00000100:00100000:0.0:1789480063.685979:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909248 00000100:00100000:0.0:1789480063.686057:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789480063.686069:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527909248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480063.686115:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480063.686182:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527909248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.686223:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789480063.687238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527909504:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687351:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527910016:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687407:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527910528:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687449:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789480063.687455:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527909632:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687634:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687655:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527910144:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687678:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687703:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527910656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480063.687757:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909632 00000100:00100000:0.0:1789480063.687766:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909632 00000100:00100000:0.0:1789480063.687810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789480063.687819:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527909632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.687873:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527909632:12345-0@lo:400:kworker.0 Request processed in 54us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.687880:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789480063.687905:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910144 00000100:00100000:0.0:1789480063.687909:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910144 00000100:00100000:0.0:1789480063.687940:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910656 00000100:00100000:0.0:1789480063.687943:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910656 00000100:00100000:0.0:1789480063.687963:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789480063.687969:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527910144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.688000:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527910144:12345-0@lo:400:kworker.0 Request processed in 31us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.688006:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789480063.688018:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789480063.688024:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527910656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.688051:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527910656:12345-0@lo:400:kworker.0 Request processed in 28us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480063.688057:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789480063.688127:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527909632:0@lo:400:kworker.0 00010000:00080000:0.0:1789480063.688141:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a78000 x1876405527910144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480063.688152:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527910144:0@lo:400:kworker.0 00000100:00100000:0.0:1789480063.688160:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527910656:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688297:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909504 00000100:00100000:2.0:1789480063.688301:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909504 00000100:00100000:2.0:1789480063.688335:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910016 00000100:00100000:2.0:1789480063.688337:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910016 00000100:00100000:2.0:1789480063.688354:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910528 00000100:00100000:2.0:1789480063.688356:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910528 00000100:00100000:2.0:1789480063.688368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789480063.688383:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527909504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688428:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527909504:12345-0@lo:400:kworker.0 Request processed in 54us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.688434:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789480063.688447:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789480063.688453:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527910016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688492:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527910016:12345-0@lo:400:kworker.0 Request processed in 40us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.688498:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789480063.688509:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789480063.688515:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527910528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688541:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527910528:12345-0@lo:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.688546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1789480063.688568:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480063.688574:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480063.688577:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480063.688605:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527909376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688640:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688667:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527909888:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688688:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688702:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527910400:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688721:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688753:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527909248:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480063.688771:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789480063.688777:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527909760:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688800:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688818:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527910272:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688838:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688857:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527910784:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688878:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480063.688905:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909376 00000100:00100000:2.0:1789480063.688910:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909376 00000100:00100000:2.0:1789480063.688938:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789480063.688945:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527909376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.688980:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527909376:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.688987:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1789480063.689014:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909888 00000100:00100000:2.0:1789480063.689017:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909888 00000100:00100000:2.0:1789480063.689038:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910400 00000100:00100000:2.0:1789480063.689041:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910400 00000100:00100000:2.0:1789480063.689051:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527909760 00000100:00100000:2.0:1789480063.689060:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527909760 00000100:00100000:2.0:1789480063.689076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789480063.689082:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527909888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689114:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527909888:12345-0@lo:400:kworker.0 Request processed in 32us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.689120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789480063.689131:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789480063.689137:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527910400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689163:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527910400:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.689169:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789480063.689179:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789480063.689184:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689250:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527909760:12345-0@lo:400:kworker.0 Request processed in 65us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.689256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789480063.689273:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910272 00000100:00100000:2.0:1789480063.689277:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910272 00000100:00100000:2.0:1789480063.689314:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910784 00000100:00100000:2.0:1789480063.689317:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910784 00000100:00100000:2.0:1789480063.689331:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789480063.689337:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527910272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689367:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527910272:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.689373:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789480063.689383:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789480063.689389:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527910784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689424:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527910784:12345-0@lo:400:kworker.0 Request processed in 36us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480063.689431:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1789480063.689449:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480063.689452:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480063.689455:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480063.689485:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527909504:0@lo:400:kworker.0 00010000:00080000:2.0:1789480063.689500:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987faed80 x1876405527910016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480063.689511:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527910016:0@lo:400:kworker.0 00010000:00080000:2.0:1789480063.689522:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a79500 x1876405527910528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480063.689530:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527910528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689558:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527909760:0@lo:400:kworker.0 00010000:00080000:2.0:1789480063.689568:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a79c00 x1876405527910272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480063.689576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527910272:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689585:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527910784:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689592:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527909376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689601:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987fadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527909888:0@lo:400:kworker.0 00000100:00100000:2.0:1789480063.689609:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527910400:0@lo:400:kworker.0 00000100:00100000:1.0:1789480064.198599:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527910912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480064.198692:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480064.198850:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527910912 00000100:00100000:1.0:1789480064.198860:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527910912 00000100:00100000:1.0:1789480064.198921:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789480064.198931:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527910912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789480064.198969:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480064.199023:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527910912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480064.199032:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789480064.199062:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527911040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480064.199090:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480064.199126:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911040 00000100:00100000:1.0:1789480064.199145:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911040 00000100:00100000:1.0:1789480064.199169:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789480064.199175:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527911040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789480064.199187:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480064.199241:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527911040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480064.199248:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789480064.199312:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527911040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480064.199347:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527910912:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789480064.325341:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480065.348451:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480065.670106:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789480065.732894:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480066.246581:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527911168:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480066.246646:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480066.246716:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911168 00000100:00100000:0.0:1789480066.246723:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911168 00000100:00100000:0.0:1789480066.246772:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789480066.246782:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527911168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480066.246808:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480066.246851:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527911168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.246857:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00010000:00080000:0.0:1789480066.246896:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a78380 x1876405527911168/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480066.246914:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527911168:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789480066.246999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480066.247608:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480066.247618:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527911296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480066.247651:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480066.247683:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911296 00000100:00100000:1.0:1789480066.247688:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911296 00000100:00100000:1.0:1789480066.247718:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789480066.247724:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527911296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480066.247736:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480066.247763:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527911296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480066.247769:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789480066.247784:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789480066.247803:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866ec380 x1876405527911296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480066.247816:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527911296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789480066.372357:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480066.764381:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527911424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480066.764452:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480066.769636:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911424 00000100:00100000:1.0:1789480066.769650:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911424 00000100:00100000:1.0:1789480066.769700:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789480066.769710:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527911424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480066.769742:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789480066.769813:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527911424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (5361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480066.769834:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789480066.769901:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527911424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480066.901569:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480066.901610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480066.901657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480066.901682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480066.901707:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480066.901747:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883392 00000100:00100000:2.0:1789480066.901756:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883392 00000100:00100000:2.0:1789480066.901802:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 387 00000100:00100000:2.0:1789480066.901812:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507883392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480066.901886:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507883392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480066.901894:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 387 00000100:00100000:2.0:1789480066.901926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883520 00000100:00100000:2.0:1789480066.901930:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883520 00000100:00100000:2.0:1789480066.901963:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883776 00000100:00100000:2.0:1789480066.901967:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883776 00000100:00100000:2.0:1789480066.901980:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883648 00000100:00100000:2.0:1789480066.901983:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883648 00000100:00100000:2.0:1789480066.901993:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507883904 00000100:00100000:2.0:1789480066.901995:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507883904 00000100:00100000:2.0:1789480066.902008:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:2.0:1789480066.902014:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507883520:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480066.902250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 304 00000100:00100000:0.0:1789480066.902260:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507883776:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480066.902300:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507883776:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 43us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.902305:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 304 00000100:00100000:2.0:1789480066.902310:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507883520:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480066.902317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 303 00000100:00100000:0.0:1789480066.902326:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 305 00000100:00100000:2.0:1789480066.902332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 306 00000100:00100000:0.0:1789480066.902332:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507883648:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480066.902337:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507883904:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480066.902356:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507883904:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.902356:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507883648:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480066.902362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 305 00000100:00100000:2.0:1789480066.902507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 306 00000100:00080000:2.0:1789480066.902662:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480066.902667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480067.397970:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480068.423471:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480068.805045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527911552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480068.805119:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480068.805329:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911552 00000100:00100000:0.0:1789480068.805337:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911552 00000100:00100000:0.0:1789480068.805390:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789480068.805399:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527911552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480068.805431:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480068.805475:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527911552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480068.805482:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789480068.805854:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527911552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480068.805990:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480068.806001:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527911808:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806051:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.806088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911808 00000100:00100000:2.0:1789480068.806093:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911808 00000100:00100000:2.0:1789480068.806124:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789480068.806132:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527911808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806170:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527911808:12345-0@lo:400:kworker.0 Request processed in 40us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.806175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1789480068.806226:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527911808:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806277:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527911936:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806303:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.806335:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911936 00000100:00100000:2.0:1789480068.806339:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911936 00000100:00100000:2.0:1789480068.806363:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480068.806369:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527911936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806404:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527911936:12345-0@lo:400:kworker.0 Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.806421:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480068.806452:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527911936:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806507:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480068.806514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527912320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806535:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.806560:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912320 00000100:00100000:2.0:1789480068.806563:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912320 00000100:00100000:2.0:1789480068.806601:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789480068.806608:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527912320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806640:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527912320:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.806645:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:2.0:1789480068.806659:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789480068.806682:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb56ad80 x1876405527912320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480068.806691:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527912320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806719:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527912448:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806741:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.806769:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912448 00000100:00100000:2.0:1789480068.806772:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912448 00000100:00100000:2.0:1789480068.806799:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789480068.806805:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527912448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806837:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527912448:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.806842:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:2.0:1789480068.806866:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789480068.806883:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb56ad80 x1876405527912448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480068.806892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527912448:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806925:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480068.806931:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527912832:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.806954:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.806977:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912832 00000100:00100000:2.0:1789480068.806981:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912832 00000100:00100000:2.0:1789480068.807006:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1789480068.807012:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527912832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.807041:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527912832:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.807046:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00080000:2.0:1789480068.807058:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789480068.807074:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb568000 x1876405527912832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480068.807082:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527912832:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.807108:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527912960:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.807129:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480068.807151:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912960 00000100:00100000:2.0:1789480068.807155:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912960 00000100:00100000:2.0:1789480068.807177:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789480068.807183:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527912960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.807238:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527912960:12345-0@lo:400:kworker.0 Request processed in 55us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.807266:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1789480068.807281:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480068.807297:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527912960:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527911680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807488:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807527:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527912192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807549:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527912704:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807588:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807605:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789480068.807610:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527912064:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807630:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807646:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527912576:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807665:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807681:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527913088:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807712:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480068.807740:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912192 00000100:00100000:3.0:1789480068.807744:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912192 00000100:00100000:3.0:1789480068.807773:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912704 00000100:00100000:3.0:1789480068.807776:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912704 00000100:00100000:3.0:1789480068.807791:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912064 00000100:00100000:3.0:1789480068.807794:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912064 00000100:00100000:3.0:1789480068.807806:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789480068.807812:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527912192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807848:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527912192:12345-0@lo:400:kworker.0 Request processed in 37us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.807863:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789480068.807877:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789480068.807882:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807911:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527912704:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.807916:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789480068.807928:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789480068.807933:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.807958:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527912064:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.807963:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789480068.807978:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527912576 00000100:00100000:3.0:1789480068.807982:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527912576 00000100:00100000:3.0:1789480068.808003:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913088 00000100:00100000:3.0:1789480068.808006:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913088 00000100:00100000:3.0:1789480068.808036:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789480068.808041:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527912576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.808069:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527912576:12345-0@lo:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.808074:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789480068.808086:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789480068.808092:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527913088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.808115:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527913088:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480068.808120:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1789480068.808144:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480068.808146:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480068.808148:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480068.808176:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987faed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527912064:0@lo:400:kworker.0 00010000:00080000:3.0:1789480068.808227:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb56ad80 x1876405527912576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480068.808237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527912576:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.808247:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb568000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527913088:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.808266:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb4dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527912192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480068.808274:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527912704:0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.810389:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527911680 00000100:00100000:2.0:1789480068.810400:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527911680 00000100:00100000:2.0:1789480068.810461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789480068.810470:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527911680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480068.810552:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527911680:12345-0@lo:400:kworker.0 Request processed in 84us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480068.810559:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789480068.811946:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527911680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480069.318456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527913216:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480069.318521:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480069.318594:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913216 00000100:00100000:3.0:1789480069.318602:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913216 00000100:00100000:3.0:1789480069.318657:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789480069.318667:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527913216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480069.318694:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480069.318747:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527913216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480069.318754:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789480069.318793:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527913216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480069.323511:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527913344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480069.323576:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480069.323673:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913344 00000100:00100000:0.0:1789480069.323680:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913344 00000100:00100000:0.0:1789480069.323729:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789480069.323739:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abbbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527913344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480069.323759:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480069.323819:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abbbfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527913344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480069.323826:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789480069.324033:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527913344:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789480069.444393:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480069.992291:0:14072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:47:48 (1789480068) 00010000:00010000:1.0:1789480070.468928:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480071.365298:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527913472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480071.365379:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480071.365551:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913472 00000100:00100000:0.0:1789480071.365557:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913472 00000100:00100000:0.0:1789480071.365622:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789480071.365631:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527913472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480071.365657:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480071.365714:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527913472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.365721:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00080000:0.0:1789480071.365757:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a7b800 x1876405527913472/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480071.365776:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527913472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480071.365825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527913600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480071.365851:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789480071.366519:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480071.370835:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913600 00000100:00100000:2.0:1789480071.370849:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913600 00000100:00100000:2.0:1789480071.371008:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789480071.371019:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527913600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480071.371043:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480071.371130:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527913600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (5278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.371137:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00080000:2.0:1789480071.371181:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866efb80 x1876405527913600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480071.371221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527913600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789480071.375762:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480071.487759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480071.487866:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884032 00000100:00100000:0.0:1789480071.487875:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884032 00000100:00100000:0.0:1789480071.487967:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:0.0:1789480071.487978:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:11103:x1876405507884032:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480071.487997:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480071.488018:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ab5 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488074:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488087:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488100:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480071.488406:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789480071.488410:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480071.488446:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488469:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ab5 expref: 7 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488488:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ab5 expref: 6 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480071.488496:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16300) 00010000:00010000:0.0:1789480071.488499:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480071.488502:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db800, rc 0) 00000100:00100000:0.0:1789480071.488551:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:11103:x1876405507884032:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 576us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.488558:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00080000:3.0:1789480071.488744:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480071.497359:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480071.522258:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480071.522355:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884160 00000100:00100000:3.0:1789480071.522372:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884160 00000100:00100000:3.0:1789480071.522466:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:3.0:1789480071.522478:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+6:11104:x1876405507884160:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.522505:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.522729:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d536 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2abc expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522812:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522830:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522844:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522863:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522870:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522877:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522987:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.522996:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524177:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480071.524336:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789480071.524340:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480071.524371:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524385:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524393:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524401:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524408:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480071.524412:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524421:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524435:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16300) 00010000:00010000:3.0:1789480071.524450:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.524457:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524464:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d53d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524484:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524490:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524497:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524501:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480071.524504:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524511:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.524519:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a6a97c2ef00) 00010000:00010000:3.0:1789480071.526725:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.526748:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.526773:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d544 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.526858:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d536 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2abc expref: 8 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.526904:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2abc expref: 7 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.526914:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6a97c2e200) 00010000:00010000:3.0:1789480071.526917:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480071.526920:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6400, rc 0) 00000100:00100000:3.0:1789480071.528725:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11104:x1876405507884160:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 6235us (6471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.528741:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1789480071.536223:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480071.536395:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884288 00000100:00100000:2.0:1789480071.536417:0:6531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884288 00000100:00100000:2.0:1789480071.536475:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480071.536485:0:6531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11104:x1876405507884288:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789480071.536569:0:6531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11104:x1876405507884288:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 Request processed in 86us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.536577:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480071.545942:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480071.546067:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884544 00000100:00100000:3.0:1789480071.546084:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884544 00000100:00100000:3.0:1789480071.546168:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1789480071.546180:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11104:x1876405507884544:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480071.546265:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480071.546294:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d552 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ac3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.546385:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.546402:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.546415:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.547735:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.547769:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.547782:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548033:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7000/0xdaa289fda243d567 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548042:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7000/0xdaa289fda243d567 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548049:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7000/0xdaa289fda243d567 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480071.548060:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789480071.548188:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548291:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548301:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548307:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480071.548311:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548319:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548346:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6a97c2e200) 00010000:00010000:3.0:1789480071.548348:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.548353:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548359:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d559 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548372:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548378:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548383:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548388:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480071.548391:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548397:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548404:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a6a97c2ef00) 00010000:00010000:3.0:1789480071.548406:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.548408:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548413:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d560 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548770:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d552 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ac3 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548786:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7000/0xdaa289fda243d567 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ac3 expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480071.548792:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:3.0:1789480071.548795:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480071.548797:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7000, rc 0) 00000100:00100000:3.0:1789480071.549288:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11104:x1876405507884544:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 3108us (3352us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789480071.549298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1789480071.556176:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480071.556301:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884672 00000100:00100000:0.0:1789480071.556315:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884672 00000100:00100000:0.0:1789480071.556389:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1789480071.556399:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11104:x1876405507884672:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789480071.556507:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11104:x1876405507884672:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480071.556514:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1789480071.566174:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480071.566632:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884800 00000100:00100000:3.0:1789480071.566650:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884800 00000100:00080000:2.0:1789480071.566743:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480071.566754:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1789480071.566769:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:11104:x1876405507884800:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789480071.568151:0:12158:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1324us 00000100:00100000:3.0:1789480071.596882:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:11104:x1876405507884800:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 30099us (30700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480071.596900:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000040:00080000:3.0:1789480071.813055:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480071.877378:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527913728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480071.877490:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480071.877738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913728 00000100:00100000:2.0:1789480071.877749:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913728 00000100:00100000:2.0:1789480071.877807:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789480071.877818:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527913728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480071.877863:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789480071.877933:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527913728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480071.877940:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789480071.878028:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb569180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527913728:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789480071.879358:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789480072.021690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480072.022613:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480072.022673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480072.022717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885184 00000100:00100000:3.0:1789480072.022729:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885184 00000100:00100000:3.0:1789480072.022803:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885056 00000100:00100000:3.0:1789480072.022807:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885056 00000100:00100000:3.0:1789480072.022836:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 313 00000100:00100000:3.0:1789480072.022849:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507885184:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480072.022940:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507885184:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.022948:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 313 00000100:00100000:3.0:1789480072.022967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 314 00000100:00100000:3.0:1789480072.022973:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507885056:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480072.025622:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2401:x1876405507885056:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 2630us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480072.025641:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 314 00000100:00080000:3.0:1789480072.025909:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480072.025917:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480072.031434:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507884928 00000100:00100000:2.0:1789480072.031456:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507884928 00000100:00100000:2.0:1789480072.031538:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 389 00000100:00100000:2.0:1789480072.031550:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507884928:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480072.031653:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507884928:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 105us (9977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480072.031662:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 389 00010000:00010000:2.0:1789480072.516318:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480073.541339:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480073.823858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480073.824216:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885312 00000100:00100000:3.0:1789480073.824235:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885312 00000100:00100000:3.0:1789480073.824300:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:3.0:1789480073.824310:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11146:x1876405507885312:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480073.824327:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480073.824347:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d575 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2aca expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824406:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824430:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824442:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824459:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824574:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824582:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824623:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789480073.824738:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480073.824786:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824796:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824801:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480073.824805:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824812:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824824:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16300) 00010000:00010000:3.0:1789480073.824834:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.824840:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824847:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d57c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824861:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824867:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824873:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.824878:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480073.824881:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825043:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825116:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a6aa31c0f00) 00010000:00010000:3.0:1789480073.825120:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.825123:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825128:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d583 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825163:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d575 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aca expref: 10 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825179:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16300) 00010000:00010000:3.0:1789480073.825182:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.825186:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d575 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aca expref: 10 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.825245:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7e00, rc 0) 00000100:00100000:3.0:1789480073.825309:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11146:x1876405507885312:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1000us (1459us total) trans 0 rc 301/301 00000100:00100000:3.0:1789480073.825316:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:2.0:1789480073.835803:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480073.836852:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885568 00000100:00100000:3.0:1789480073.836864:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885568 00000100:00100000:3.0:1789480073.836930:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1789480073.836940:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11146:x1876405507885568:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:3.0:1789480073.836997:0:8915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480073.837022:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d52f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ab5 expref: 9 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837043:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a8be16300) 00010000:00010000:3.0:1789480073.837064:0:8915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480073.837123:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837135:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837145:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837178:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837186:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837221:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837879:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837890:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837898:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480073.837910:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007317fbeb reply state 00000000689081c7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837920:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837927:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480073.837930:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480073.837932:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789480073.837936:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789480073.837942:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837948:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837961:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837966:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480073.837970:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837978:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837986:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480073.837989:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.837992:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.837998:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d58a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480073.838012:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007317fbeb reply state 00000000689081c7 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.838019:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.838025:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a6aa31c0e00) 00010000:00010000:3.0:1789480073.838027:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480073.838029:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789480073.838167:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:11146:x1876405507885568:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 1226us (2370us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789480073.838174:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:2.0:1789480073.925793:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527913856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480073.925860:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480073.926880:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913856 00000100:00100000:3.0:1789480073.927351:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527913984:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.927403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.927462:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527914496:0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.927596:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913856 00000100:00100000:1.0:1789480073.927668:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527913984 00000100:00100000:1.0:1789480073.927672:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527913984 00000100:00100000:1.0:1789480073.927712:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789480073.927719:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527913984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.927763:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527913984:12345-0@lo:400:kworker.0 Request processed in 45us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.927770:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789480073.927778:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789480073.927785:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527913856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480073.927810:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480073.928264:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527913856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 479us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480073.928271:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789480073.928300:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527914368:0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.928328:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480073.928353:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527914880:0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.928375:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480073.928394:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527915392:0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.928412:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914368 00000100:00100000:2.0:1789480073.928413:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480073.928416:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914368 00000100:00100000:1.0:1789480073.928441:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789480073.928447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527913856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480073.928447:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527914368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.928505:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527914368:12345-0@lo:400:kworker.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.928511:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1789480073.928553:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527914112:0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.928588:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480073.928625:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527914624:0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.928703:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914112 00000100:00100000:1.0:1789480073.928708:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914112 00000100:00100000:1.0:1789480073.928734:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789480073.928740:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527914112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.928770:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527914112:12345-0@lo:400:kworker.0 Request processed in 30us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.928776:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1789480073.928902:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.928922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527915008:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.928940:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.928967:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527913984:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.928986:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914880 00000100:00100000:3.0:1789480073.928989:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914880 00000100:00100000:3.0:1789480073.929020:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527915392 00000100:00100000:3.0:1789480073.929023:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527915392 00000100:00100000:0.0:1789480073.929037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.929041:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789480073.929047:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527914880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.929092:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914496 00000100:00100000:1.0:1789480073.929096:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914496 00000100:00100000:1.0:1789480073.929118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527915008 00000100:00100000:1.0:1789480073.929121:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527915008 00000100:00100000:0.0:1789480073.929127:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527915136:0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.929132:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914624 00000100:00100000:1.0:1789480073.929135:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914624 00000100:00100000:1.0:1789480073.929158:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789480073.929165:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527914496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.929270:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527914368:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929416:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527914880:12345-0@lo:400:kworker.0 Request processed in 369us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.929423:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789480073.929435:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789480073.929441:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527915392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929478:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527915392:12345-0@lo:400:kworker.0 Request processed in 25us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.929485:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789480073.929506:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789480073.929512:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527915008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929543:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527915008:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.929559:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789480073.929572:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789480073.929577:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527914624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.929590:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480073.929619:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527914112:0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.929628:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789480073.929698:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527914240:0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.929725:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480073.929744:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527914752:0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.929764:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.929777:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527914624:12345-0@lo:400:kworker.0 Request processed in 199us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480073.929777:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527915264:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929783:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789480073.929795:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527915136 00000100:00100000:0.0:1789480073.929796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480073.929798:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527915136 00000100:00100000:3.0:1789480073.929814:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00010000:00080000:0.0:1789480073.929816:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a7aa00 x1876405527914624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480073.929819:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527915136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480073.929827:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527914624:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929852:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527915136:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.929857:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00080000:3.0:1789480073.929873:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480073.929877:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789480073.929879:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480073.929881:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480073.929888:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914752 00000100:00100000:3.0:1789480073.929892:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914752 00000100:00100000:3.0:1789480073.929910:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527915264 00000100:00100000:3.0:1789480073.929913:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527915264 00000100:00100000:3.0:1789480073.929923:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789480073.929929:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527914752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.929959:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527914752:12345-0@lo:400:kworker.0 Request processed in 30us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.929965:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789480073.929975:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789480073.929990:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527915264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.930018:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527915264:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.930022:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1789480073.930043:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480073.930045:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480073.930062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527915008:0@lo:400:kworker.0 00010000:00080000:3.0:1789480073.930081:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a78380 x1876405527914752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480073.930091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527914752:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.930098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527915264:0@lo:400:kworker.0 00010000:00080000:3.0:1789480073.930105:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a79c00 x1876405527915136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480073.930112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527915136:0@lo:400:kworker.0 00010000:00080000:2.0:1789480073.930186:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a7b100 x1876405527914880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480073.930429:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527914880:0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.930442:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a862f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527915392:0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.930775:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527914496:12345-0@lo:400:kworker.0 Request processed in 1609us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.930790:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1789480073.930812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527914240 00000100:00100000:1.0:1789480073.930816:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527914240 00000100:00100000:1.0:1789480073.930846:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789480073.930853:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527914240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480073.930894:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527914240:12345-0@lo:400:kworker.0 Request processed in 41us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480073.930899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789480073.930969:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527914496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480073.930993:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527914240:0@lo:400:kworker.0 00000100:00100000:2.0:1789480073.935541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480073.936181:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885696 00000100:00100000:3.0:1789480073.936209:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885696 00000100:00100000:3.0:1789480073.936279:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1789480073.936290:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:11154:x1876405507885696:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:3.0:1789480073.936310:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480073.936331:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d59f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ad1 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936406:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936419:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936432:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480073.936472:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789480073.936476:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480073.936511:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936533:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d59f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad1 expref: 12 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936549:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad1 expref: 11 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.936557:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480073.936560:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480073.936564:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7e00, rc 0) 00000100:00100000:3.0:1789480073.936626:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:11154:x1876405507885696:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 337us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.936632:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:1.0:1789480073.997967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480073.998108:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507885824 00000100:00100000:3.0:1789480073.998119:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507885824 00000100:00100000:3.0:1789480073.998249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:3.0:1789480073.998259:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:11160:x1876405507885824:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480073.998280:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480073.998302:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d5ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ad8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998377:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998391:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998402:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998413:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998420:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998427:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998499:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998508:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998515:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480073.998559:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789480073.998563:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480073.998615:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998628:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998635:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998642:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998648:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480073.998652:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998659:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998671:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480073.998674:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.998678:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998683:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d5b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998696:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998712:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998718:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998723:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480073.998726:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998732:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998740:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a6aa31c0e00) 00010000:00010000:3.0:1789480073.998742:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480073.998745:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998751:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d5bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998774:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d5ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad8 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998787:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad8 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480073.998795:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480073.998797:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480073.998805:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6a00, rc 0) 00000100:00100000:3.0:1789480073.998870:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+12:11160:x1876405507885824:12345-192.168.206.44@tcp:101:bash.0 Request processed in 612us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480073.998878:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:2.0:1789480074.005125:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.005251:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886080 00000100:00100000:1.0:1789480074.005260:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886080 00000100:00100000:1.0:1789480074.005322:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:1.0:1789480074.005331:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+12:11160:x1876405507886080:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480074.005350:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480074.005369:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d5c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2adf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005466:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005480:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005491:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005506:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005524:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005532:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480074.005827:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789480074.005949:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005958:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.005966:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006012:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006020:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006026:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006032:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480074.006036:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006043:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006064:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480074.006067:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480074.006072:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006078:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d5d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480074.006091:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f223cc95 reply state 000000000f3e16f1 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006101:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006107:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:1.0:1789480074.006109:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789480074.006112:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789480074.006138:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d5c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006151:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.006158:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:1.0:1789480074.006160:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480074.006163:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bda00, rc 0) 00000100:00100000:1.0:1789480074.006269:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+15:11160:x1876405507886080:12345-192.168.206.44@tcp:101:bash.0 Request processed in 939us (1151us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789480074.006277:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:2.0:1789480074.021641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.021720:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886208 00000100:00100000:3.0:1789480074.021730:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886208 00000100:00100000:3.0:1789480074.021774:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:3.0:1789480074.021782:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876405507886208:12345-192.168.206.44@tcp:8:bash.0 00010000:00080000:3.0:1789480074.021812:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:3.0:1789480074.021840:0:8436:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d5ec 00002000:00100000:3.0:1789480074.021850:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f7386f76-6ebd-4087-bc50-a71a216590e4/ffff8a6ac1b31800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789480074.021867:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789480074.021936:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789480074.021962:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8a6ac1b32800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480074.022143:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507886208:12345-192.168.206.44@tcp:8:bash.0 Request processed in 359us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480074.022150:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:0.0:1789480074.024522:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.024627:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886336 00000100:00100000:3.0:1789480074.024636:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886336 00000100:00100000:3.0:1789480074.024703:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:3.0:1789480074.024711:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507886336:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480074.024725:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480074.024745:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ae6 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480074.024767:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480074.024796:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1789480074.024800:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480074.024808:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 7 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.024827:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 7 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.024839:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6600, rc 0) 00000100:00100000:3.0:1789480074.024888:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:0:x1876405507886336:12345-192.168.206.44@tcp:101:bash.0 Request processed in 178us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480074.024895:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00080000:0.0:1789480074.025000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480074.030653:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.034547:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886464 00000100:00100000:1.0:1789480074.034560:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886464 00000100:00100000:1.0:1789480074.034658:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1789480074.034668:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11160:x1876405507886464:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480074.034683:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480074.034701:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2aed expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.034729:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.034737:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480074.034741:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480074.034746:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.034774:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.034786:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 8 pid: 8493 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.034798:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876405527915520:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480074.034882:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480074.046532:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.047458:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886592 00000100:00100000:0.0:1789480074.047468:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886592 00010000:00010000:0.0:1789480074.047509:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 9 pid: 8493 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480074.047554:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1789480074.047564:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507886592:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480074.047591:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480074.047611:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 9 pid: 8493 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.047625:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 9 pid: 8493 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.047650:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480074.047654:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480074.047663:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.047673:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.047707:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480074.047722:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876405527915648:192.168.206.44@tcp:105: 00000100:00100000:0.0:1789480074.047802:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989ce40 going to sleep for 11 seconds 00010000:00010000:1.0:1789480074.055036:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243d5f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ae6 expref: 9 pid: 8493 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.055275:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866eca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876405527915520:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480074.055859:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.055881:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc600, rc 0) 00000100:00100000:1.0:1789480074.055944:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:11160:x1876405507886464:12345-192.168.206.44@tcp:101:bash.0 Request processed in 21276us (25297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.055952:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:2.0:1789480074.061528:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.061599:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507886848 00000100:00100000:1.0:1789480074.061608:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507886848 00000100:00100000:1.0:1789480074.061662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1789480074.061671:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+15:11160:x1876405507886848:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1789480074.061937:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11160:x1876405507886848:12345-192.168.206.44@tcp:35:bash.0 Request processed in 266us (417us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789480074.061944:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1789480074.062085:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876405527915648:192.168.206.44@tcp:105: 00010000:00010000:0.0:1789480074.062104:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480074.062384:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507886592:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 14563us (15601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.062393:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1789480074.169349:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.169507:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507887104 00000100:00100000:3.0:1789480074.169515:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507887104 00000100:00100000:3.0:1789480074.169575:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1789480074.169586:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11170:x1876405507887104:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480074.169613:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480074.169631:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d601 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2af4 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480074.169725:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789480074.169808:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d601 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2af4 expref: 18 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.169820:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480074.169822:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480074.169827:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d601 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2af4 expref: 18 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.169851:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7200, rc 0) 00000100:00100000:3.0:1789480074.169905:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+17:11170:x1876405507887104:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 320us (563us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789480074.169912:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1789480074.173010:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.178283:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507887360 00000100:00100000:1.0:1789480074.178299:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507887360 00000100:00100000:0.0:1789480074.178980:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:0.0:1789480074.178992:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+17:11170:x1876405507887360:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1789480074.179273:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+18:11170:x1876405507887360:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 283us (6271us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789480074.179281:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480074.248814:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.248960:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507887488 00000100:00100000:1.0:1789480074.248973:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507887488 00000100:00100000:1.0:1789480074.249039:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480074.249058:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+18:11176:x1876405507887488:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480074.249082:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480074.249101:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d60f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2afb expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249183:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249246:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249259:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480074.249299:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789480074.249303:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480074.249324:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249351:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d60f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2afb expref: 20 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249379:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2afb expref: 19 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.249388:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480074.249390:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480074.249394:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc800, rc 0) 00000100:00100000:1.0:1789480074.249449:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11176:x1876405507887488:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 392us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.249456:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480074.253870:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480074.253962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507887744 00000100:00100000:2.0:1789480074.253976:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507887744 00000100:00100000:2.0:1789480074.254052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:2.0:1789480074.254062:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11176:x1876405507887744:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480074.254081:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480074.254102:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d61d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b02 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.255594:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d624 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.255608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.255619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d624 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480074.255630:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789480074.255730:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d61d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b02 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.255749:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d624 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b02 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.255757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:2.0:1789480074.255771:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480074.255774:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1000, rc 0) 00000100:00100000:2.0:1789480074.256350:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11176:x1876405507887744:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 2286us (2492us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789480074.256359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:3.0:1789480074.263373:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.263650:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888000 00000100:00100000:1.0:1789480074.263683:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888000 00000100:00100000:1.0:1789480074.263760:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:1.0:1789480074.263773:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11176:x1876405507888000:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480074.263807:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480074.263834:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d632 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b09 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.264089:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.264109:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.264124:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480074.264141:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789480074.264330:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d632 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b09 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.264351:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b09 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.264360:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:1.0:1789480074.264362:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480074.264367:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd600, rc 0) 00000100:00100000:1.0:1789480074.264442:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+23:11176:x1876405507888000:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 672us (1085us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789480074.264451:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:1.0:1789480074.271630:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.271806:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888128 00000100:00100000:3.0:1789480074.271819:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888128 00000100:00100000:3.0:1789480074.271909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1789480074.271922:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:2402:x1876405507888128:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480074.271941:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480074.271973:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d624 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b02 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.272137:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:3.0:1789480074.272144:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480074.272255:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2402:x1876405507888128:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 335us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480074.272262:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1789480074.277017:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.277169:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888256 00000100:00100000:3.0:1789480074.277182:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888256 00000100:00100000:3.0:1789480074.277296:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1789480074.277308:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507888256:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:3.0:1789480074.277364:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.277401:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.277410:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789480074.277415:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480074.277420:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.277464:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.277481:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 7 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480074.277497:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8493:1876405527915776:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480074.277829:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f600 going to sleep for 11 seconds 00000100:00100000:3.0:1789480074.283127:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8493:1876405527915776:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480074.283164:0:8493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480074.284047:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.286905:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888384 00000100:00100000:1.0:1789480074.286921:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888384 00002000:00100000:1.0:1789480074.286973:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a6abb56ad80 x1876405507888384/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:225/0 lens 504/0 e 0 to 0 dl 1789480085 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480074.286984:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb56ad80 with x1876405507888384 ext(0->12) 00010000:00010000:1.0:1789480074.286994:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 8 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.287011:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 8 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480074.287019:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6abb56ad80 00000100:00100000:1.0:1789480074.287124:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1789480074.287133:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507888384:12345-192.168.206.44@tcp:4:lfs.0 00000001:00100000:2.0:1789480074.291121:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000100:00100000:1.0:1789480074.291874:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507888384:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 4735us (7841us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789480074.291885:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00002000:00100000:1.0:1789480074.291896:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a6abb56ad80 x1876405507888384/t4294967300(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:225/0 lens 504/448 e 0 to 0 dl 1789480085 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789480074.291907:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb56ad80 with x1876405507888384 ext(0->12) 00010000:00010000:1.0:1789480074.291917:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.291934:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480074.291953:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6abb56ad80 00000100:00100000:2.0:1789480074.304514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.305880:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888512 00000100:00100000:0.0:1789480074.305893:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888512 00010000:00010000:0.0:1789480074.305938:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480074.305992:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:0.0:1789480074.306003:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507888512:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480074.306017:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789480074.306034:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789480074.306037:0:9525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789480073 00002000:00010000:0.0:1789480074.306040:0:9525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789480074 00002000:00010000:0.0:1789480074.306042:0:9525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789480073 00002000:00010000:0.0:1789480074.306044:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789480074.306050:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.306064:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.306107:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243d5fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aed expref: 9 pid: 8435 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.306125:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480074.306129:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480074.306135:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.306887:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.306920:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480074.307054:0:8493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307065:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307088:0:8493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307097:0:8493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307105:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307112:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480074.307116:0:8493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307125:0:8493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307151:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.307171:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177d3e6a/0xdaa289fda243d647 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480074.308648:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507888512:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 2636us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.308662:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:1.0:1789480074.317898:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507888256:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 40580us (40882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.317914:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1789480074.326795:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.326885:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888768 00000100:00100000:1.0:1789480074.326894:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888768 00000100:00100000:1.0:1789480074.326947:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1789480074.326958:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11176:x1876405507888768:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:1.0:1789480074.327027:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b09 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480074.327295:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789480074.327341:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789480074.327615:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:1.0:1789480074.327653:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.327669:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.327678:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.327710:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.327737:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 26 pid: 6520 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.327751:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1876405527915904:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480074.327830:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480074.332445:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.332656:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6524:1876405527915904:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480074.332685:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480074.332877:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507888896 00000100:00100000:2.0:1789480074.332885:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507888896 00010000:00010000:2.0:1789480074.332920:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 27 pid: 6520 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480074.332956:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:2.0:1789480074.332966:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+27:2401:x1876405507888896:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480074.332981:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480074.333001:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 27 pid: 6520 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333014:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 27 pid: 6520 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333037:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2adf expref: 27 pid: 6520 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333053:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:2.0:1789480074.333059:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333082:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333090:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.333125:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480074.333212:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+26:2401:x1876405507888896:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 222us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480074.333220:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00010000:00010000:1.0:1789480074.333561:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.333570:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480074.333672:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789480074.333799:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789480074.333882:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1876405527916032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789480074.333927:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480074.333960:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480074.334079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527916032 00000100:00100000:0.0:1789480074.334086:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527916032 00000100:00100000:0.0:1789480074.334127:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480074.334136:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876405527916032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789480074.334243:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876405527916032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.334255:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480074.334298:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ec000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1876405527916032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789480074.334431:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789480074.334481:0:6524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1876405527916160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789480074.334510:0:6524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480074.334528:0:6524:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480074.334541:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527916160 00000100:00100000:0.0:1789480074.334545:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527916160 00000100:00100000:0.0:1789480074.334567:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789480074.334883:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876405527916160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789480074.335001:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1876405527916160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 122us (489us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789480074.335056:0:6524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6524:1876405527916160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789480074.335095:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789480074.335126:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335147:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335155:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335160:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480074.335165:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335172:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335186:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:2.0:1789480074.335208:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789480074.335222:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.335239:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d64e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480074.335339:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789480074.335400:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789480074.335411:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443259220298ns, next at 444259218175ns, rc = 0 00000001:00080000:2.0:1789480074.335417:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1789480074.335437:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6abb5b2300) 00010000:00010000:2.0:1789480074.335440:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480074.335446:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d639 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b09 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480074.335524:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+29:11176:x1876405507888768:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 8568us (8737us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789480074.335532:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000020:00080000:2.0:1789480074.335536:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789480074.335740:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789480074.342023:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.345891:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507889024 00000100:00100000:1.0:1789480074.345905:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507889024 00000100:00100000:0.0:1789480074.346421:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1789480074.346434:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+29:11176:x1876405507889024:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480074.346456:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480074.346480:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d655 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b10 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.346535:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d655 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b10 expref: 30 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.346550:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d655 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b10 expref: 30 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.346567:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:0.0:1789480074.346570:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480074.346574:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dba00, rc 0) 00000100:00100000:0.0:1789480074.346639:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11176:x1876405507889024:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 208us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.346662:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:1.0:1789480074.352658:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.352747:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507889280 00000100:00100000:0.0:1789480074.352834:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507889280 00000100:00100000:0.0:1789480074.352891:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:0.0:1789480074.352901:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11176:x1876405507889280:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1789480074.353652:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+31:11176:x1876405507889280:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 749us (999us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789480074.353661:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:1.0:1789480074.435651:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480074.435762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507889536 00000100:00100000:2.0:1789480074.435771:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507889536 00000100:00100000:2.0:1789480074.435833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1789480074.435843:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+31:11186:x1876405507889536:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480074.435867:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480074.435888:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d65c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b17 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480074.435984:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789480074.436074:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d65c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b17 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.436112:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480074.436115:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480074.436121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d65c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b17 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.436134:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:0.0:1789480074.436334:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480074.436350:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527916288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480074.436399:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480074.436459:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527916288 00000100:00100000:0.0:1789480074.436464:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527916288 00000100:00100000:0.0:1789480074.436493:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789480074.436501:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527916288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480074.436522:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480074.436564:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527916288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.436571:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789480074.436617:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527916288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480074.436909:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480074.436919:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527916416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480074.436955:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480074.436994:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527916416 00000100:00100000:0.0:1789480074.436998:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527916416 00000100:00100000:0.0:1789480074.437034:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789480074.437045:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527916416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789480074.437055:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480074.437092:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527916416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480074.437099:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789480074.437126:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6985dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527916416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480074.437487:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11186:x1876405507889536:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1645us (1843us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1789480074.437500:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:0.0:1789480074.449992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.454705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507889664 00000100:00100000:1.0:1789480074.454720:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507889664 00000100:00100000:1.0:1789480074.454796:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:1.0:1789480074.454818:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11186:x1876405507889664:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:1.0:1789480074.454888:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.454905:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.454917:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.454928:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.454935:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.454942:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455019:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455029:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455036:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480074.455084:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455415:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455430:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455436:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455442:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480074.455446:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455453:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455464:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480074.455467:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480074.455472:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455478:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d66a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455490:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455496:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455501:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455505:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480074.455514:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455520:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455528:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:1.0:1789480074.455531:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480074.455534:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455540:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d671 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455549:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455554:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455559:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455564:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480074.455567:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455572:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455578:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480074.455581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480074.455589:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.455595:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d678 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.455674:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11186:x1876405507889664:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 857us (5697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.455682:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:3.0:1789480074.461495:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480074.463886:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507889920 00000100:00100000:2.0:1789480074.463898:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507889920 00000100:00100000:2.0:1789480074.464039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1789480074.464051:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11186:x1876405507889920:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480074.464314:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+33:11186:x1876405507889920:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 265us (2826us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789480074.464321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1789480074.533134:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.533319:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507890176 00000100:00100000:3.0:1789480074.533347:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507890176 00000100:00100000:3.0:1789480074.533422:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480074.533435:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+33:11189:x1876405507890176:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480074.533469:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480074.533498:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d67f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b1e expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533615:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533632:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533644:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533654:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533661:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533667:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533819:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533828:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533836:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480074.533858:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789480074.533952:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533960:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533967:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.533974:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480074.533979:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534866:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534886:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480074.534895:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480074.534903:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534911:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d686 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534933:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534940:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534965:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534970:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480074.534974:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.534980:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.535159:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:3.0:1789480074.535162:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480074.535165:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.535171:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.535363:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d67f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 36 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.535381:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 35 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.535389:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480074.535391:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480074.535394:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030200, rc 0) 00000100:00100000:3.0:1789480074.535493:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11189:x1876405507890176:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 2060us (2372us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789480074.535513:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480074.538337:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.538461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507890304 00000100:00100000:1.0:1789480074.538474:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507890304 00000100:00100000:1.0:1789480074.538554:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1789480074.538566:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11189:x1876405507890304:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1789480074.538660:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538679:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538693:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538736:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538743:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538750:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538757:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480074.538779:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538788:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538801:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480074.538804:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480074.538810:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.538817:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.538912:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11189:x1876405507890304:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 347us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.538920:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1789480074.541866:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.541966:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507890560 00000100:00100000:0.0:1789480074.541979:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507890560 00000100:00100000:0.0:1789480074.542063:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789480074.542076:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11189:x1876405507890560:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1789480074.542626:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+36:11189:x1876405507890560:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 550us (772us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789480074.542635:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00010000:00010000:2.0:1789480074.564821:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480074.752715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480074.753085:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507890816 00000100:00100000:1.0:1789480074.753101:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507890816 00000100:00100000:1.0:1789480074.753186:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:1.0:1789480074.753246:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+36:11220:x1876405507890816:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1789480074.753554:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480074.753583:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b25 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.753843:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d6b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.753862:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.753894:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480074.753910:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789480074.754155:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d6a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b25 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.754179:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b25 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.754254:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480074.754264:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480074.754269:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bcc00, rc 0) 00000100:00100000:1.0:1789480074.754548:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11220:x1876405507890816:12345-192.168.206.44@tcp:101:cat.0 Request processed in 1115us (1656us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789480074.754558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:0.0:1789480074.759137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.759236:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.759355:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891072 00000100:00100000:3.0:1789480074.759368:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891072 00000100:00100000:3.0:1789480074.759438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1789480074.759450:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11220:x1876405507891072:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:1.0:1789480074.759761:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891200 00000100:00100000:1.0:1789480074.759766:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891200 00000100:00100000:1.0:1789480074.759808:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1789480074.759816:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+40:2400:x1876405507891200:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480074.759832:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480074.759861:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d6b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b25 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480074.759879:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480074.759885:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480074.760445:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+39:11220:x1876405507891072:12345-192.168.206.44@tcp:35:cat.0 Request processed in 993us (1317us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789480074.760455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:1.0:1789480074.760536:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+38:2400:x1876405507891200:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 719us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480074.760544:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1789480074.816974:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480074.817329:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891456 00000100:00100000:0.0:1789480074.817343:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891456 00000100:00100000:0.0:1789480074.817427:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1789480074.817439:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11226:x1876405507891456:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1789480074.817473:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480074.817497:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789480074.817535:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d616 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2afb expref: 38 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817560:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480074.817567:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480074.817584:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d6be lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b2c expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817724:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817741:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 38 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817752:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817860:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 38 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.817877:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 38 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480074.817891:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916544:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480074.818079:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480074.821439:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb505180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916544:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480074.821479:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480074.822833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480074.822978:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891584 00000100:00100000:2.0:1789480074.822998:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891584 00010000:00010000:2.0:1789480074.823050:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 39 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480074.823093:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1789480074.823104:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+39:2402:x1876405507891584:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480074.823123:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480074.823131:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 39 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823166:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 39 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823231:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d694 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b1e expref: 39 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823255:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480074.823261:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823272:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823282:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480074.823316:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480074.823396:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+38:2402:x1876405507891584:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 292us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480074.823404:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00010000:00010000:0.0:1789480074.823482:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.823492:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480074.823523:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789480074.823733:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d6be lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 39 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.823750:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 38 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480074.823758:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:0.0:1789480074.823772:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789480074.823776:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:0.0:1789480074.823805:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11226:x1876405507891456:12345-192.168.206.44@tcp:101:dd.0 Request processed in 6369us (7154us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789480074.823813:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1789480074.827399:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.827532:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891712 00000100:00100000:3.0:1789480074.827546:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891712 00000100:00100000:3.0:1789480074.827632:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:3.0:1789480074.827645:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11226:x1876405507891712:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:3.0:1789480074.827680:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480074.827708:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d6d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b33 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.827753:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.827912:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.827944:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.828101:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d6d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 40 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.828125:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 39 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.828134:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480074.828137:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480074.828141:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80031c00, rc 0) 00000100:00100000:2.0:1789480074.828671:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+39:11226:x1876405507891712:12345-192.168.206.44@tcp:101:dd.0 Request processed in 1024us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480074.828681:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:1.0:1789480074.832088:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480074.832251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507891968 00000100:00100000:3.0:1789480074.832264:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507891968 00000100:00100000:3.0:1789480074.832327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:3.0:1789480074.832340:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+39:11226:x1876405507891968:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:3.0:1789480074.833550:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.833580:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.833737:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480074.833796:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789480074.833822:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3fa966f reply state 00000000ddce6978 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.833854:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480074.833862:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480074.833864:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480074.833870:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480074.834127:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+42:11226:x1876405507891968:12345-192.168.206.44@tcp:36:dd.0 Request processed in 1784us (2047us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789480074.834138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000020:00080000:3.0:1789480074.834145:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480075.038725:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480075.038901:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507892096 00000100:00100000:0.0:1789480075.038914:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507892096 00000100:00080000:3.0:1789480075.039076:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480075.039128:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:0.0:1789480075.039143:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+42:11240:x1876405507892096:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:0.0:1789480075.039175:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480075.039317:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d6e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b3a expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039403:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039422:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039457:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039472:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039480:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039486:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039586:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039598:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039608:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039652:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.039667:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 43 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480075.039682:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916672:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480075.040144:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480075.044002:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.044393:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507892352 00000100:00100000:2.0:1789480075.044405:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507892352 00000100:00100000:2.0:1789480075.044480:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1789480075.044493:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+44:6179:x1876405507892352:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789480075.044923:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+45:6179:x1876405507892352:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 431us (943us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789480075.044932:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1789480075.046428:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916672:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480075.046465:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480075.048238:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.048565:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507892480 00000100:00100000:2.0:1789480075.048579:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507892480 00010000:00010000:2.0:1789480075.048647:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 45 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480075.048695:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:2.0:1789480075.048706:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+45:2402:x1876405507892480:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480075.048725:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480075.048732:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 45 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048745:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 45 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048779:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d6c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b2c expref: 45 pid: 12158 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048800:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.048805:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048816:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048846:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.048882:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480075.048953:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+44:2402:x1876405507892480:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 249us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.048962:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00010000:00010000:3.0:1789480075.049826:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.049839:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480075.049909:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789480075.049913:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480075.049962:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.049977:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050090:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050097:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050105:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050111:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.050117:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050125:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050139:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480075.050142:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.050147:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050154:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d6ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050169:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050175:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050181:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050264:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.050268:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050275:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050284:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:3.0:1789480075.050286:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.050289:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050296:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d6f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050339:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d6e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b3a expref: 44 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050355:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b3a expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.050363:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480075.050365:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480075.050367:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db200, rc 0) 00000100:00100000:3.0:1789480075.050437:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+43:11240:x1876405507892096:12345-192.168.206.44@tcp:101:stat.0 Request processed in 11297us (11725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480075.050446:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:3.0:1789480075.119252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.119370:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507892736 00000100:00100000:2.0:1789480075.119384:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507892736 00000100:00100000:2.0:1789480075.119466:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1789480075.119478:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+43:11246:x1876405507892736:12345-192.168.206.44@tcp:36:truncate.0 00010000:00010000:2.0:1789480075.119557:0:8915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480075.119595:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d6fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b3a expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.119637:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.119643:0:8915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480075.119882:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.119899:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.119910:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480075.119958:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789480075.119982:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9806051 reply state 000000005753f065 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.120004:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.120011:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.120014:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480075.120017:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480075.120158:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+45:11246:x1876405507892736:12345-192.168.206.44@tcp:36:truncate.0 Request processed in 681us (972us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789480075.120166:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000020:00080000:2.0:1789480075.120172:0:8915:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480075.280773:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.280856:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507892864 00000100:00100000:3.0:1789480075.280870:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507892864 00000100:00100000:3.0:1789480075.280938:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1789480075.280950:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+45:11261:x1876405507892864:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:3.0:1789480075.281349:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480075.281387:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d70b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b41 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281619:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281639:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281653:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281666:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281673:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281681:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281909:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281921:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.281950:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480075.282071:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1789480075.282076:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480075.282100:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282113:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282122:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282130:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282138:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282145:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80030400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.282150:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282263:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282278:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480075.282282:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.282287:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d712 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282324:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282331:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282337:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.282342:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80030200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.282346:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284262:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284298:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:3.0:1789480075.284302:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.284310:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284318:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d719 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284496:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d70b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284516:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.284543:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480075.284546:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480075.284549:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6c00, rc 0) 00000100:00100000:3.0:1789480075.284646:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+46:11261:x1876405507892864:12345-192.168.206.44@tcp:101:stat.0 Request processed in 3697us (3885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480075.284657:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:0.0:1789480075.390526:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.390637:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507893120 00000100:00100000:3.0:1789480075.390652:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507893120 00000100:00100000:3.0:1789480075.390732:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:3.0:1789480075.390743:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+46:11271:x1876405507893120:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480075.390783:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480075.390811:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d727 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b48 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480075.390938:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789480075.391074:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d727 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b48 expref: 48 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.391090:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480075.391093:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480075.391099:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b48 expref: 48 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.391115:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6600, rc 0) 00000100:00100000:3.0:1789480075.391277:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+47:11271:x1876405507893120:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 535us (765us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1789480075.391307:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:1.0:1789480075.395270:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.396145:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507893376 00000100:00100000:2.0:1789480075.396162:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507893376 00000100:00100000:2.0:1789480075.396278:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1789480075.396287:0:6524:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789480075.396293:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+47:11271:x1876405507893376:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480075.396303:0:6524:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789480075.396589:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+48:11271:x1876405507893376:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 300us (1332us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789480075.396597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:1.0:1789480075.466257:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.466493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507893632 00000100:00100000:2.0:1789480075.466506:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507893632 00000100:00100000:2.0:1789480075.466577:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:2.0:1789480075.466588:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+48:11277:x1876405507893632:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480075.466617:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480075.466643:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d735 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b4f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.466787:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.466821:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.466832:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.466869:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 49 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.466884:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 49 pid: 6522 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480075.466900:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527916800:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480075.467035:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480075.475107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.476115:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527916800:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480075.476151:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480075.476668:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507893760 00000100:00100000:3.0:1789480075.476678:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507893760 00010000:00010000:3.0:1789480075.476731:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 50 pid: 6522 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480075.476827:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480075.476838:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+50:2401:x1876405507893760:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480075.476866:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480075.476875:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 50 pid: 6522 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.476889:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 50 pid: 6522 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.476913:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d720 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b41 expref: 50 pid: 6522 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.476932:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480075.476938:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.476949:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.476958:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.477015:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480075.477094:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+49:2401:x1876405507893760:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 257us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480075.477101:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00010000:00010000:2.0:1789480075.477217:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.477237:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480075.477262:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789480075.477441:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d735 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.477479:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.477488:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.477491:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480075.477493:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480075.477524:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+49:11277:x1876405507893632:12345-192.168.206.44@tcp:101:bash.0 Request processed in 10938us (11282us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789480075.477532:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789480075.485996:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.486087:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894016 00000100:00100000:3.0:1789480075.486100:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894016 00000100:00100000:3.0:1789480075.486179:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1789480075.486233:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+49:11277:x1876405507894016:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:2.0:1789480075.486972:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.486997:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.487011:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480075.487059:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789480075.487082:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9b3d945 reply state 00000000127fc49d transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.487096:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.487105:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.487108:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480075.487113:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480075.487278:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+52:11277:x1876405507894016:12345-192.168.206.44@tcp:36:bash.0 Request processed in 1087us (1305us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789480075.487304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000020:00080000:2.0:1789480075.487311:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480075.496060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.496168:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894144 00000100:00100000:3.0:1789480075.496182:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894144 00000100:00100000:3.0:1789480075.496295:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:3.0:1789480075.496306:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+52:11277:x1876405507894144:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480075.496348:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480075.496383:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d751 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b56 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.496487:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.496504:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.496513:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.496550:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.496583:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 53 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480075.496609:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916928:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480075.496716:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480075.502110:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527916928:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480075.502158:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480075.507926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.508249:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894272 00000100:00100000:2.0:1789480075.508261:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894272 00010000:00010000:2.0:1789480075.508308:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 54 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480075.508355:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1789480075.508366:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+54:2402:x1876405507894272:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480075.508384:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480075.508394:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 54 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508410:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 54 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508435:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d73c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b4f expref: 54 pid: 6520 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508455:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.508461:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508473:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508482:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.508542:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480075.508626:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+53:2402:x1876405507894272:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 260us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.508634:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00010000:00010000:3.0:1789480075.508717:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.508726:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480075.508798:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789480075.508804:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480075.508830:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.508869:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d751 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b56 expref: 53 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.508887:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b56 expref: 52 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.508896:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480075.508909:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480075.508912:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6600, rc 0) 00000100:00100000:3.0:1789480075.508943:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+52:11277:x1876405507894144:12345-192.168.206.44@tcp:101:bash.0 Request processed in 12639us (12896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480075.508950:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:1.0:1789480075.514490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.514584:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894528 00000100:00100000:3.0:1789480075.514605:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894528 00000100:00100000:3.0:1789480075.514674:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1789480075.514686:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+52:11277:x1876405507894528:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1789480075.514971:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11277:x1876405507894528:12345-192.168.206.44@tcp:35:bash.0 Request processed in 287us (645us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789480075.519083:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00010000:00010000:2.0:1789480075.588413:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480075.613318:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.613434:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894784 00000100:00100000:2.0:1789480075.613447:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894784 00000100:00100000:2.0:1789480075.613528:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:2.0:1789480075.613541:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11287:x1876405507894784:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480075.613572:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480075.613598:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d75f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b5d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480075.613731:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789480075.613863:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d75f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b5d expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.613879:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480075.613882:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480075.613888:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d75f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b5d expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.613905:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480075.613987:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11287:x1876405507894784:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 448us (681us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1789480075.613995:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:1.0:1789480075.616864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.616970:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507894912 00000100:00100000:2.0:1789480075.616992:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507894912 00000100:00100000:2.0:1789480075.617073:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:2.0:1789480075.617084:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11287:x1876405507894912:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:2.0:1789480075.617184:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617231:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617244:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617257:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617264:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617270:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617370:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617379:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617386:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480075.617442:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617472:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617479:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617486:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617492:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480075.617498:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617506:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617519:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480075.617522:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480075.617527:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617534:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d76d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617550:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617556:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617562:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617572:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480075.617575:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617581:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617590:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:2.0:1789480075.617592:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480075.617595:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617601:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617611:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617616:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617621:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617627:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480075.617629:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617636:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617655:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.617657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480075.617660:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.617667:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d77b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480075.617929:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11287:x1876405507894912:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 845us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.617939:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:1.0:1789480075.620675:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.620873:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507895168 00000100:00100000:3.0:1789480075.620886:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507895168 00000100:00100000:3.0:1789480075.620963:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1789480075.620985:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11287:x1876405507895168:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480075.621302:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+55:11287:x1876405507895168:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 329us (640us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789480075.621309:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1789480075.653827:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.653927:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507895424 00000100:00100000:3.0:1789480075.653941:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507895424 00000100:00100000:3.0:1789480075.654028:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:3.0:1789480075.654041:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+55:11290:x1876405507895424:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480075.654072:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480075.654099:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d782 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b64 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654272:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654289:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654302:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654315:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654322:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654329:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654466:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654475:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654482:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480075.654493:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789480075.654588:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654608:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654615:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654621:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.654627:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654635:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654651:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480075.654654:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.654660:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654667:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243d789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654684:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654690:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654695:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654700:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480075.654708:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654716:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654725:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:3.0:1789480075.654728:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480075.654731:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654737:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d790 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654781:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243d782 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b64 expref: 58 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654796:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b64 expref: 57 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.654804:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480075.654806:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480075.654809:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030200, rc 0) 00000100:00100000:3.0:1789480075.654888:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb035880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+57:11290:x1876405507895424:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 850us (1076us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789480075.654896:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:0.0:1789480075.657928:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480075.658126:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507895552 00000100:00100000:1.0:1789480075.658139:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507895552 00000100:00100000:1.0:1789480075.658248:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:1.0:1789480075.658261:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+57:11290:x1876405507895552:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1789480075.658358:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658382:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658396:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658465:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658473:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658480:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658487:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480075.658492:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658501:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658516:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480075.658519:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480075.658525:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.658532:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d7a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480075.658623:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+57:11290:x1876405507895552:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 364us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480075.658631:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:1.0:1789480075.662713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480075.662872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.662947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507895936 00000100:00100000:3.0:1789480075.662961:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507895936 00000100:00100000:3.0:1789480075.663042:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1789480075.663054:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+57:11290:x1876405507895936:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480075.663398:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11290:x1876405507895936:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 346us (525us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789480075.663407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789480075.667500:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507895680 00000100:00100000:0.0:1789480075.667523:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507895680 00000100:00100000:0.0:1789480075.668431:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1789480075.668449:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+58:2399:x1876405507895680:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480075.668474:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480075.668512:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b64 expref: 58 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.668539:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:0.0:1789480075.668545:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480075.668772:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+57:2399:x1876405507895680:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 329us (6070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480075.668781:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1789480075.787336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.787472:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507896192 00000100:00100000:2.0:1789480075.787485:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507896192 00000100:00100000:2.0:1789480075.787565:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1789480075.787577:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+57:11308:x1876405507896192:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:2.0:1789480075.787610:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480075.787638:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b6b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.787777:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.787797:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.787810:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480075.787823:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789480075.787994:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b6b expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.788016:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b6b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.788025:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.788029:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789480075.788033:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0a00, rc 0) 00000100:00100000:2.0:1789480075.788326:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11308:x1876405507896192:12345-192.168.206.44@tcp:101:cat.0 Request processed in 750us (1003us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789480075.788335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:1.0:1789480075.813353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.813478:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507896320 00000100:00100000:2.0:1789480075.813492:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507896320 00000100:00100000:2.0:1789480075.813572:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:2.0:1789480075.813585:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11309:x1876405507896320:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480075.813618:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480075.813644:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b72 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813736:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813754:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813768:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480075.813863:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789480075.813868:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480075.813893:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813926:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b72 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813950:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b72 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.813959:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480075.813962:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480075.813966:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480075.814060:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11309:x1876405507896320:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 478us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.814068:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:1.0:1789480075.821342:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.821681:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507896704 00000100:00100000:2.0:1789480075.821694:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507896704 00000100:00100000:2.0:1789480075.821765:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1789480075.821777:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11309:x1876405507896704:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480075.822164:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11309:x1876405507896704:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 389us (846us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789480075.822173:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789480075.826652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.833469:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507896832 00000100:00100000:2.0:1789480075.833492:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507896832 00000100:00100000:2.0:1789480075.833622:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1789480075.833635:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11309:x1876405507896832:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:2.0:1789480075.833660:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789480075.833694:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243d758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b56 expref: 61 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.833726:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b6b expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.833740:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d655 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b10 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.833751:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.833757:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480075.833869:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11309:x1876405507896832:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 236us (7230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.833878:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1789480075.838773:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480075.839061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507896960 00000100:00100000:0.0:1789480075.839074:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507896960 00000100:00100000:0.0:1789480075.839147:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:0.0:1789480075.839159:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11309:x1876405507896960:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:0.0:1789480075.839523:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.839546:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.839571:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480075.839959:0:6521:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480075.840131:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789480075.842119:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789480075.842403:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11309:x1876405507896960:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 3239us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480075.842416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:3.0:1789480075.895300:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.895471:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897088 00000100:00100000:2.0:1789480075.895485:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897088 00000100:00100000:2.0:1789480075.895569:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:2.0:1789480075.895592:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11311:x1876405507897088:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480075.895626:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480075.895653:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b79 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895788:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895820:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895834:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895848:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895855:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895862:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895952:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895961:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.895968:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480075.896032:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789480075.896037:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480075.896061:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896076:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896098:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896105:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896111:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896117:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480075.896122:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896132:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896145:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480075.896148:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480075.896153:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896160:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d7dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896175:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896181:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896186:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896266:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480075.896270:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896277:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896287:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:2.0:1789480075.896290:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480075.896293:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896300:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d7e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896335:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d7d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896350:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.896357:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:2.0:1789480075.896360:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480075.896363:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1400, rc 0) 00000100:00100000:2.0:1789480075.896437:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11311:x1876405507897088:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 857us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480075.896446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000040:00080000:2.0:1789480075.910487:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480075.910517:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480075.910576:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789480075.910602:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480075.910786:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527917056:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480075.911164:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480075.915463:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480075.915624:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527917056:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480075.915660:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897216 00000100:00100000:1.0:1789480075.915671:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897216 00000100:00100000:1.0:1789480075.915740:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:1.0:1789480075.915750:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11315:x1876405507897216:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789480075.915790:0:8915:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789480075.915943:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11315:x1876405507897216:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 193us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480075.915952:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:1.0:1789480075.924508:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480075.924962:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897344 00000100:00100000:0.0:1789480075.924987:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897344 00000100:00100000:0.0:1789480075.925078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:0.0:1789480075.925091:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11315:x1876405507897344:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480075.925187:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.925267:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.925282:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929850:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929875:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929889:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929958:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.929976:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480075.930034:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789480075.930039:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480075.930053:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930066:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930073:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930080:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930086:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480075.930090:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930099:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930111:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:0.0:1789480075.930120:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480075.930126:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930133:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d7f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930148:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930154:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930160:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930165:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480075.930168:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930174:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930181:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8a6a8be16500) 00010000:00010000:0.0:1789480075.930183:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480075.930186:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d7f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930252:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930264:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930269:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930273:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480075.930276:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930282:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930289:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:0.0:1789480075.930292:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480075.930294:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.930300:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480075.930391:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11315:x1876405507897344:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 5299us (5893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480075.930401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:0.0:1789480075.943156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480075.943368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897600 00000100:00100000:1.0:1789480075.943379:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897600 00000100:00100000:1.0:1789480075.943447:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:1.0:1789480075.943458:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11315:x1876405507897600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480075.943477:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480075.943496:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d807 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b80 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943612:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943628:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943640:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480075.943669:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789480075.943744:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943752:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943759:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943766:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480075.943770:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943778:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943790:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480075.943793:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480075.943797:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943803:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d80e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943846:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d807 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b80 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943856:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:1.0:1789480075.943859:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480075.943872:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d807 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b80 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480075.943882:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bda00, rc 0) 00000100:00100000:1.0:1789480075.943942:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507897600:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 486us (797us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789480075.943950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:1.0:1789480075.952466:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.952611:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897728 00000100:00100000:3.0:1789480075.952621:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897728 00000100:00100000:3.0:1789480075.952676:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:3.0:1789480075.952686:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507897728:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480075.952720:0:12158:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480075.952856:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507897728:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 171us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480075.952864:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:1.0:1789480075.955857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480075.956007:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507897984 00000100:00100000:3.0:1789480075.956025:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507897984 00000100:00100000:3.0:1789480075.956106:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789480075.956121:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507897984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480075.956149:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480075.956153:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480075.956187:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d7c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b72 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480075.956249:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480075.956256:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480075.956273:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d81c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b87 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480075.956890:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789480075.960898:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d823 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.960926:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.960941:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d823 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.963352:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d81c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b87 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.963396:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d823 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b87 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480075.963407:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6987bf1c00) 00010000:00010000:2.0:1789480075.963410:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480075.963414:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:2.0:1789480075.963508:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11315:x1876405507897984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 7390us (7659us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789480075.963518:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00000040:00080000:3.0:1789480075.973136:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480075.980500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480075.987130:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507898240 00000100:00100000:0.0:1789480075.987144:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507898240 00000100:00100000:0.0:1789480075.987287:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:0.0:1789480075.987299:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11315:x1876405507898240:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480075.987377:0:8915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480075.987400:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d823 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b87 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987418:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6987bf1c00) 00010000:00010000:0.0:1789480075.987427:0:8915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480075.987446:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987459:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987469:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987481:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987487:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987494:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987536:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987542:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987549:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987831:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480075.987836:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987845:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987853:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480075.987856:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480075.987859:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987865:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243d831 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987877:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987883:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987889:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987893:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480075.987895:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987901:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987919:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1c738c4c (ffff8a6a8be16500) 00010000:00010000:0.0:1789480075.987922:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480075.987925:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.987931:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243d838 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1c738c4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480075.988518:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507898240:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 1215us (8019us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480075.990113:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:1.0:1789480075.993872:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480075.993935:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507898368 00000100:00100000:0.0:1789480075.993948:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507898368 00000100:00100000:0.0:1789480075.994020:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:0.0:1789480075.994030:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11315:x1876405507898368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480075.994048:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480075.994070:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d83f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b8e expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994106:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994118:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994131:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994298:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243d83f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994331:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480075.994339:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:0.0:1789480075.994342:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480075.994345:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db800, rc 0) 00000100:00100000:0.0:1789480075.994411:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11315:x1876405507898368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 381us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480075.994419:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:1.0:1789480076.002959:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.004746:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507898624 00000100:00100000:2.0:1789480076.004883:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507898624 00000100:00100000:2.0:1789480076.005692:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:2.0:1789480076.005715:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11315:x1876405507898624:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480076.005942:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.005964:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.006132:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480076.006361:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789480076.006372:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 444930181332ns, next at 445930177955ns, rc = 0 00000004:00010000:2.0:1789480076.006432:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c38e5d89 reply state 000000000a093d24 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.006447:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.006456:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480076.006459:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789480076.006464:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480076.006654:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11315:x1876405507898624:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 945us (3708us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789480076.006662:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:1.0:1789480076.013834:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.013941:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507898752 00000100:00100000:2.0:1789480076.013954:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507898752 00000100:00100000:2.0:1789480076.014033:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:2.0:1789480076.014046:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11315:x1876405507898752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480076.014090:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480076.014119:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b95 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.014245:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 64 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.014262:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 64 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.014287:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480076.014291:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480076.014296:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:2.0:1789480076.014365:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+64:11315:x1876405507898752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 322us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.014374:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1789480076.022800:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.022931:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507898880 00000100:00100000:0.0:1789480076.022944:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507898880 00000100:00100000:0.0:1789480076.023010:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:0.0:1789480076.023020:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876405507898880:12345-192.168.206.44@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789480076.023062:0:8436:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1789480076.023101:0:8436:0:(genops.c:1384:class_connect()) connect: client f7386f76-6ebd-4087-bc50-a71a216590e4, cookie 0xdaa289fda243d85b 00002000:00100000:0.0:1789480076.023116:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f7386f76-6ebd-4087-bc50-a71a216590e4/ffff8a6a8611a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789480076.023129:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789480076.023260:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789480076.023298:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8a6a8611b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480076.023376:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2398:x1876405507898880:12345-192.168.206.44@tcp:8:lhsmtool_posix.0 Request processed in 356us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480076.023384:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1789480076.025755:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.026085:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507899008 00000100:00100000:2.0:1789480076.026097:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507899008 00000100:00100000:2.0:1789480076.026265:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:2.0:1789480076.026278:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:0:x1876405507899008:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789480076.030060:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789480076.036427:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1789480076.036460:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000100:00100000:1.0:1789480076.051300:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:0:x1876405507899008:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 25009us (25542us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789480076.051316:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:1.0:1789480076.054260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.055883:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507899264 00000100:00100000:3.0:1789480076.055901:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507899264 00000100:00100000:3.0:1789480076.055985:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1789480076.055998:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+64:11315:x1876405507899264:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480076.056346:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11315:x1876405507899264:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 349us (2094us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789480076.056355:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1789480076.060723:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.060931:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507899520 00000100:00100000:1.0:1789480076.060944:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507899520 00000100:00100000:1.0:1789480076.061117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:1.0:1789480076.061130:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11315:x1876405507899520:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789480076.061303:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11315:x1876405507899520:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 176us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480076.061311:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:3.0:1789480076.063690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.064114:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507899648 00000100:00100000:2.0:1789480076.064129:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507899648 00000100:00100000:2.0:1789480076.064229:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:2.0:1789480076.064241:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11315:x1876405507899648:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480076.064266:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480076.064299:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2b9c expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064389:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064407:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064420:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480076.064475:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480076.064497:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064530:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243d862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b9c expref: 67 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064548:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b9c expref: 66 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.064558:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480076.064561:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789480076.064565:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480076.064710:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11315:x1876405507899648:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 470us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.064718:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:3.0:1789480076.067559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.067717:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507899776 00000100:00100000:2.0:1789480076.067730:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507899776 00000100:00100000:2.0:1789480076.067869:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:2.0:1789480076.067882:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2401:x1876405507899776:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480076.067905:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480076.067932:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ba3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480076.067963:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c8b, blocks: 0x0 00010000:00010000:2.0:1789480076.068000:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=444s v=(0 0) 00010000:00010000:2.0:1789480076.068005:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480076.068016:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.068038:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.068054:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789480076.068124:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507899776:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 246us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.068131:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:3.0:1789480076.071244:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.071290:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900032 00000100:00100000:3.0:1789480076.071302:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900032 00000100:00100000:3.0:1789480076.071368:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:3.0:1789480076.071380:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11315:x1876405507900032:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789480076.071514:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11315:x1876405507900032:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 136us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480076.071522:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:3.0:1789480076.073951:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.074314:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900160 00000100:00100000:1.0:1789480076.074332:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900160 00000100:00100000:1.0:1789480076.074429:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1789480076.074440:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:11315:x1876405507900160:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480076.074461:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480076.074486:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2baa expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.074523:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.074533:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480076.074538:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480076.074545:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.074695:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.074712:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 7 pid: 8436 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.074728:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527917184:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480076.074912:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789480076.078034:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.078115:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527917184:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480076.078127:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900288 00000100:00100000:3.0:1789480076.078138:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900288 00010000:00010000:0.0:1789480076.078160:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078182:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 8 pid: 8436 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.078330:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1789480076.078341:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507900288:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480076.078359:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480076.078386:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 8 pid: 8436 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078400:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 8 pid: 8436 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078430:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243d870 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ba3 expref: 8 pid: 8436 timeout: 544 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078447:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789480076.078451:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480076.078460:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078470:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.078509:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.078525:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876405527917312:192.168.206.44@tcp:105: 00000100:00100000:3.0:1789480076.078930:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1fd80 going to sleep for 11 seconds 00010000:00010000:0.0:1789480076.079621:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd800, rc 0) 00000100:00100000:0.0:1789480076.079680:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11315:x1876405507900160:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 5238us (5734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480076.079689:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1789480076.084319:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876405527917312:192.168.206.44@tcp:105: 00010000:00010000:1.0:1789480076.084355:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480076.084410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.084446:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507900288:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 6106us (6422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480076.084476:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:2.0:1789480076.084511:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900416 00000100:00100000:2.0:1789480076.084522:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900416 00002000:00100000:2.0:1789480076.084574:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a6a866ee300 x1876405507900416/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:227/0 lens 504/0 e 0 to 0 dl 1789480087 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480076.084586:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6a866ee300 with x1876405507900416 ext(0->8) 00002000:00010000:2.0:1789480076.084592:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6a866ee300 00000100:00100000:2.0:1789480076.084620:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789480076.084639:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507900416:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789480076.086025:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507900416:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 1377us (1606us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789480076.086044:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00002000:00100000:3.0:1789480076.086055:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a6a866ee300 x1876405507900416/t4294967303(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:227/0 lens 504/448 e 0 to 0 dl 1789480087 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480076.086066:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6a866ee300 with x1876405507900416 ext(0->8) 00002000:00010000:3.0:1789480076.086071:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6a866ee300 00000100:00100000:1.0:1789480076.091032:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.091128:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900544 00000100:00100000:3.0:1789480076.091142:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900544 00000100:00100000:3.0:1789480076.091255:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:3.0:1789480076.091268:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11315:x1876405507900544:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789480076.096567:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1789480076.096589:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789480076.096615:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096630:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096639:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096647:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.096653:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096663:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480076.096667:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789480076.096692:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6ab989ccc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789480076.096698:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b22200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a6ab989c480 00010000:00010000:3.0:1789480076.096701:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a6aa31c0e00) 00000020:00080000:1.0:1789480076.096702:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b22900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6987ee8800 00010000:00010000:3.0:1789480076.096708:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.096716:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096723:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243d591 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096750:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096757:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096763:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096769:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.096772:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096777:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096785:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480076.096787:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.096791:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096797:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243d598 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096828:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096835:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096840:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096846:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.096850:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096856:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096866:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb5b2500) 00010000:00010000:3.0:1789480076.096869:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.096872:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096878:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d5d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096897:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096904:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096910:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096922:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.096926:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096932:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.096943:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480076.096946:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.096949:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.096957:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+18:11315:x1876405507900544:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 5684us (5932us total) trans 0 rc 0/0 00010000:00010000:3.0:1789480076.096959:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d6e1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.096975:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00010000:00010000:3.0:1789480076.096995:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097002:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097008:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097013:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.097016:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097022:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097041:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480076.097044:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.097047:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097053:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243d704 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097066:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097073:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097079:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097085:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.097088:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097094:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097103:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480076.097105:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.097108:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097114:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243d74a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097137:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097144:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097151:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097157:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.097160:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097166:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097174:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:3.0:1789480076.097177:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480076.097180:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.097187:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243d84d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.097245:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480076.097263:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6aaa2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527917440:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1789480076.097267:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789480076.097478:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789480076.097494:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527917568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789480076.097550:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480076.097616:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480076.101587:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527917568 00000100:00100000:2.0:1789480076.101607:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527917568 00000100:00100000:2.0:1789480076.101691:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527917440 00000100:00100000:2.0:1789480076.101695:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527917440 00000100:00100000:2.0:1789480076.101733:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789480076.101746:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527917568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789480076.101787:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1789480076.101831:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa94c89, atime: 0x6aa94c8a, ctime: 0x6aa94c89, blocks: 0x8 00010000:00010000:2.0:1789480076.101841:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.101861:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=445s v=(0 0) 00010000:00010000:2.0:1789480076.101866:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480076.101874:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.101897:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.101909:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.101934:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.101963:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480076.101983:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480076.101993:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.102004:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480076.102009:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.102026:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.102048:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.102057:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243d87e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789480076.102059:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480076.102066:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789480076.102096:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480076.102098:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480076.102100:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480076.102286:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789480076.102317:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527917440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789480076.102476:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789480076.102480:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789480075 00002000:00010000:3.0:1789480076.102483:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789480076.102485:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789480075 -> 1789480075 00002000:00010000:3.0:1789480076.102488:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789480076.102593:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527917440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 279us (4976us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789480076.102600:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1789480076.102662:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6aaa2e3800/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789480076.102670:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6aaa2e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527917440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789480076.103255:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876405527917568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1511us (5703us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789480076.103264:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:3.0:1789480076.103622:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6987d2aa00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789480076.103630:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527917568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789480076.104694:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.105747:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900672 00000100:00100000:2.0:1789480076.105763:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900672 00000100:00100000:2.0:1789480076.105848:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1789480076.105863:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507900672:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789480076.115109:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1789480076.115128:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789480076.115354:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2402:x1876405507900672:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 9486us (10658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.115367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:3.0:1789480076.122974:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.123129:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507900928 00000100:00100000:1.0:1789480076.123144:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507900928 00000100:00100000:1.0:1789480076.123240:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:1.0:1789480076.123251:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+14:11315:x1876405507900928:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789480076.123316:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480076.123341:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243d869 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b9c expref: 14 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.123360:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:1.0:1789480076.123365:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480076.123395:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.123424:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.123442:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480076.123551:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dec2ab7 reply state 00000000a4a689db transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.123564:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.123571:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:1.0:1789480076.123573:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789480076.123575:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480076.123672:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+15:11315:x1876405507900928:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 423us (713us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789480076.123679:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:3.0:1789480076.127687:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.127769:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901056 00000100:00100000:0.0:1789480076.127786:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901056 00000100:00100000:0.0:1789480076.127862:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:0.0:1789480076.127873:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507901056:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789480076.128087:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789480076.128091:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789480075 -> 1789480075 00002000:00010000:0.0:1789480076.128093:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789480074 00002000:00010000:0.0:1789480076.128095:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789480075 -> 1789480075 00002000:00010000:0.0:1789480076.128098:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789480076.128171:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507901056:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 300us (492us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789480076.128179:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:1.0:1789480076.132714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.134808:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901312 00000100:00100000:2.0:1789480076.134829:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901312 00000100:00100000:2.0:1789480076.134891:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:2.0:1789480076.134903:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+15:11315:x1876405507901312:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789480076.134979:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.134997:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.135005:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.135054:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.135067:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 15 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480076.135082:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527917696:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480076.135175:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480076.138948:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.139032:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d28a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527917696:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480076.139072:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480076.139349:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901440 00000100:00100000:2.0:1789480076.139360:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901440 00010000:00010000:2.0:1789480076.139400:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 16 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480076.139441:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:2.0:1789480076.139451:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+16:2402:x1876405507901440:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480076.139465:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480076.139472:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 16 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139484:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 16 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139504:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d846 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b8e expref: 16 pid: 6521 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139518:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480076.139532:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139542:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139561:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.139592:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480076.139638:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+15:2402:x1876405507901440:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 189us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.139646:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00010000:00010000:3.0:1789480076.139799:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139808:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139850:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139869:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139876:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139882:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047aa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.139886:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139894:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139903:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:3.0:1789480076.139906:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789480076.139910:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.139917:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243d88c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.139958:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+14:11315:x1876405507901312:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 5058us (7253us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789480076.139967:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:0.0:1789480076.148913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.149039:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901568 00000100:00100000:3.0:1789480076.149048:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901568 00000100:00100000:3.0:1789480076.149101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1789480076.149110:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507901568:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789480076.149149:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.149181:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.149208:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480076.149213:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480076.149228:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.149271:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.149285:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.149299:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527917824:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480076.149363:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480076.156781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.158942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901696 00000100:00100000:1.0:1789480076.158958:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901696 00010000:00010000:1.0:1789480076.159002:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 8 pid: 8435 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.159040:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:1.0:1789480076.159049:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507901696:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480076.159064:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480076.159084:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 8 pid: 8435 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.159115:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 8 pid: 8435 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.159140:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480076.159144:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480076.159150:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.159160:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.159180:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480076.159264:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507901696:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 216us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480076.159272:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00010000:00010000:3.0:1789480076.159639:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5c21f68/0xdaa289fda243d877 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2baa expref: 7 pid: 8435 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.159653:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527917824:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480076.159673:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159683:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159698:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159731:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159740:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159747:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159754:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480076.159758:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159767:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159783:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.159790:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4ff9384/0xdaa289fda243d893 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.159854:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507901568:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 10745us (10948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480076.159863:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:2.0:1789480076.171473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.171590:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507901952 00000100:00100000:3.0:1789480076.171599:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507901952 00000100:00100000:3.0:1789480076.171656:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 93 00000100:00100000:3.0:1789480076.171665:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+14:11315:x1876405507901952:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789480076.172269:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.172388:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 14 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.172399:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.172435:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 14 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.172450:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 14 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.172465:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527917952:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480076.172546:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480076.176148:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527917952:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480076.176230:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480076.180162:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.180397:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902080 00000100:00100000:0.0:1789480076.180407:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902080 00010000:00010000:0.0:1789480076.180447:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 15 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480076.180482:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:0.0:1789480076.180505:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+15:2401:x1876405507902080:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480076.180521:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480076.180528:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 15 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180541:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 15 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180561:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d6da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b33 expref: 15 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180578:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:0.0:1789480076.180583:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180593:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180600:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.180636:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480076.180691:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+14:2401:x1876405507902080:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 187us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480076.180697:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00010000:00010000:3.0:1789480076.180964:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.180973:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.181244:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.181256:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 14 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.181264:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.181303:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 14 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.181316:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 14 pid: 12158 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.181333:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527918080:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480076.181385:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480076.194156:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480076.194210:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902208 00000100:00100000:2.0:1789480076.194229:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902208 00010000:00010000:2.0:1789480076.194269:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 15 pid: 12158 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480076.194320:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:2.0:1789480076.194333:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+15:2401:x1876405507902208:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480076.194347:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480076.194355:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 15 pid: 12158 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.194368:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 15 pid: 12158 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.194400:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480076.194405:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.194413:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.194420:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480076.194439:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480076.194495:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+15:2401:x1876405507902208:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 164us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.194503:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00010000:00010000:0.0:1789480076.194716:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243d854 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b95 expref: 14 pid: 12158 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480076.194746:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527918080:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480076.194774:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.194786:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.194792:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480076.194895:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789480076.195007:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789480076.195041:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789480076.195114:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527918208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789480076.195157:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480076.195232:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480076.195477:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527918208 00000100:00100000:2.0:1789480076.195483:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527918208 00000100:00100000:2.0:1789480076.195520:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789480076.195527:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527918208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789480076.195611:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527918208:12345-0@lo:1000:mdt00_003.0 Request processed in 83us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480076.195618:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789480076.195677:0:8915:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789480076.195682:0:8915:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6aaa2e3800, transno 4294967304 00000100:00100000:1.0:1789480076.195701:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d48e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527918208:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789480076.195819:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1789480076.195865:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527918336:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789480076.195904:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480076.195922:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480076.196014:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527918336 00000100:00100000:0.0:1789480076.196019:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527918336 00000100:00100000:0.0:1789480076.196063:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789480076.196072:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527918336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789480076.196166:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8915:x1876405527918336:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (262us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789480076.196174:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789480076.196509:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527918336:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789480076.196539:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196559:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196566:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196571:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80030400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480076.196576:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196583:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196596:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:1.0:1789480076.196600:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480076.196604:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196610:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8a1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196640:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196646:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196653:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196658:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480076.196666:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196673:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196682:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480076.196684:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480076.196687:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196694:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243d7cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196716:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196798:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196806:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196832:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.196844:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 17 pid: 6522 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.196855:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527918464:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480076.196918:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480076.209769:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527918464:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480076.209815:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480076.215380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.215479:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902336 00000100:00100000:1.0:1789480076.215489:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902336 00010000:00010000:1.0:1789480076.215523:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 18 pid: 6522 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480076.215553:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:1.0:1789480076.215562:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+18:2401:x1876405507902336:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480076.215575:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480076.215581:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 18 pid: 6522 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215594:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 18 pid: 6522 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215615:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243d7eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2b79 expref: 18 pid: 6522 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215628:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:1.0:1789480076.215633:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215642:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215649:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.215675:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480076.215729:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+17:2401:x1876405507902336:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 156us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480076.215751:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00010000:00010000:3.0:1789480076.217303:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217325:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217345:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217353:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217362:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217380:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.217385:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217393:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217412:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480076.217416:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.217421:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217427:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243d8a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217442:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217463:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217468:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217474:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.217476:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217482:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217490:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a8be16f00) 00010000:00010000:3.0:1789480076.217492:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480076.217495:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.217500:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d89a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.217764:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11315:x1876405507901952:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 46092us (46293us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789480076.217778:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 93 00000020:00080000:3.0:1789480076.217786:0:8915:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789480076.217832:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480076.217839:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480076.217856:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789480076.217863:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480076.224578:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.224945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902592 00000100:00100000:3.0:1789480076.224962:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902592 00000100:00100000:3.0:1789480076.225041:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1789480076.225053:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11315:x1876405507902592:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789480076.225497:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789480076.225538:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789480076.225584:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225606:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225620:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225629:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225636:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225642:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.225671:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480076.225736:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480076.225764:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.225775:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480076.225779:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.225789:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.225807:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:0.0:1789480076.225809:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789480076.225815:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.225821:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8af lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480076.225838:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480076.225840:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480076.225841:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480076.226100:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:11315:x1876405507902592:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 1045us (1527us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789480076.226112:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000020:00080000:3.0:1789480076.226119:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480076.484826:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480076.484852:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527918592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480076.484924:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480076.484972:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527918592 00000100:00100000:0.0:1789480076.484983:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527918592 00000100:00080000:1.0:1789480076.485017:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480076.485055:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789480076.485064:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527918592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480076.485092:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789480076.485137:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527918592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480076.485145:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789480076.485347:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69810b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527918592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480076.488603:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480076.488625:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527918720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480076.488690:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480076.488729:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527918720 00000100:00100000:0.0:1789480076.488736:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527918720 00000100:00100000:0.0:1789480076.488807:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789480076.488817:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527918720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480076.488839:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789480076.488897:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527918720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480076.488904:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789480076.488982:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527918720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480076.618932:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480076.790908:0:14221:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480076.790921:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480076.790950:0:14221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789480076.790958:0:14221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789480076.915413:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.919802:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902848 00000100:00100000:3.0:1789480076.919834:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902848 00000100:00100000:3.0:1789480076.919919:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:3.0:1789480076.919932:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:11332:x1876405507902848:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480076.919966:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480076.920004:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d8b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bb1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.920154:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d8bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.920177:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d8bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.920223:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d8bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480076.920237:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789480076.920500:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d8b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.920519:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d8bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb1 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.920528:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480076.920532:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480076.920536:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030200, rc 0) 00000100:00100000:3.0:1789480076.920741:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+20:11332:x1876405507902848:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 810us (5343us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789480076.920750:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:0.0:1789480076.923080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.923158:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507902976 00000100:00100000:3.0:1789480076.923170:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507902976 00000100:00100000:3.0:1789480076.923463:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:3.0:1789480076.923476:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+20:11332:x1876405507902976:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1789480076.923577:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923741:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923757:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923776:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923782:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923789:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923888:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923897:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.923903:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480076.923961:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924052:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924059:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924066:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924072:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.924077:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924086:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924098:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480076.924101:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.924107:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924114:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d8cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924128:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924135:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924141:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924153:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80030400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.924156:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924162:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924169:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6aa31c0200) 00010000:00010000:3.0:1789480076.924171:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.924174:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924179:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d8d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924580:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924589:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924675:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924680:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.924683:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924689:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924709:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:3.0:1789480076.924711:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480076.924715:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.924721:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d8d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.924822:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+20:11332:x1876405507902976:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1344us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480076.924831:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:3.0:1789480076.958913:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480076.959243:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507903232 00000100:00100000:1.0:1789480076.959255:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507903232 00000100:00100000:1.0:1789480076.959327:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:1.0:1789480076.959340:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+20:11335:x1876405507903232:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480076.959367:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480076.959393:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d8e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bb8 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959560:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959579:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959706:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959724:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959738:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.959745:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960111:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960121:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960129:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480076.960139:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789480076.960280:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960287:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960295:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960301:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480076.960306:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960314:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960339:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480076.960342:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480076.960348:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960355:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d8e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960368:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960375:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960381:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960386:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480076.960389:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960394:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960401:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a87f32900) 00010000:00010000:1.0:1789480076.960403:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480076.960406:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960411:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d8ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960552:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243d8e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 23 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960568:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 22 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480076.960576:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:1.0:1789480076.960578:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480076.960581:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc600, rc 0) 00000100:00100000:1.0:1789480076.960862:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11335:x1876405507903232:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1523us (1960us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789480076.960871:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:1.0:1789480076.964897:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480076.965060:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507903360 00000100:00100000:3.0:1789480076.965074:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507903360 00000100:00100000:3.0:1789480076.965180:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:3.0:1789480076.965225:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11335:x1876405507903360:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1789480076.965318:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965340:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965356:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965404:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965411:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965443:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965450:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480076.965455:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965464:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:3.0:1789480076.965482:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480076.965488:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480076.965494:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d903 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480076.965577:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11335:x1876405507903360:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 387us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480076.965728:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:3.0:1789480076.971370:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480076.971776:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507903616 00000100:00100000:0.0:1789480076.971790:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507903616 00000100:00100000:0.0:1789480076.971870:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1789480076.971883:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11335:x1876405507903616:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:0.0:1789480076.972178:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+23:11335:x1876405507903616:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 298us (821us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1789480076.972187:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1789480077.001531:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527918848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480077.001632:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480077.001660:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527918848 00000100:00100000:0.0:1789480077.001671:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527918848 00000100:00100000:0.0:1789480077.001744:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789480077.001756:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527918848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480077.001802:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789480077.001862:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527918848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.001870:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789480077.001923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527918848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480077.012925:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.012969:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507903872 00000100:00100000:3.0:1789480077.012981:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507903872 00000100:00100000:3.0:1789480077.013059:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:3.0:1789480077.013072:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+23:10860:x1876405507903872:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480077.013102:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480077.013127:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d90a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bbf expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.013316:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.013335:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 24 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.013345:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.013386:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 24 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.013402:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 24 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.013418:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527918976:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480077.013539:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1fc00 going to sleep for 11 seconds 00000100:00080000:0.0:1789480077.015286:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480077.020986:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.021030:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904000 00000100:00100000:2.0:1789480077.021048:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904000 00010000:00010000:2.0:1789480077.021098:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 25 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.021141:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:2.0:1789480077.021152:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+25:2401:x1876405507904000:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480077.021171:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480077.021180:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 25 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.021226:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 25 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.021254:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:2.0:1789480077.021260:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.021272:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.021282:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.021305:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480077.021373:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+25:2401:x1876405507904000:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 222us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.021381:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00010000:00010000:2.0:1789480077.023125:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243d8f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb8 expref: 24 pid: 8915 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.023179:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527918976:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480077.023238:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.023249:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.023254:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480077.023280:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789480077.024334:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d90a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 25 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.024361:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 24 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.024372:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:2.0:1789480077.024375:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480077.024380:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80031c00, rc 0) 00000100:00100000:2.0:1789480077.025333:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+24:10860:x1876405507903872:12345-192.168.206.44@tcp:101:bash.0 Request processed in 12255us (12414us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789480077.025347:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:1.0:1789480077.032939:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.033003:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904128 00000100:00100000:1.0:1789480077.033018:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904128 00000100:00100000:1.0:1789480077.033092:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:1.0:1789480077.033105:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+24:10860:x1876405507904128:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480077.033140:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480077.033170:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d91f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bc6 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033255:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033274:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033298:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033450:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d91f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bc6 expref: 26 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033474:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bc6 expref: 25 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.033483:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:1.0:1789480077.033487:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789480077.033492:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bcc00, rc 0) 00000100:00100000:1.0:1789480077.033562:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+25:10860:x1876405507904128:12345-192.168.206.44@tcp:101:bash.0 Request processed in 460us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.033569:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:1.0:1789480077.038494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.039183:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904384 00000100:00100000:0.0:1789480077.039222:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904384 00000100:00100000:0.0:1789480077.039443:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 100 00000100:00100000:0.0:1789480077.039456:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+25:10860:x1876405507904384:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:0.0:1789480077.039766:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.039788:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.039801:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480077.039855:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789480077.039880:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002532f1de reply state 00000000cdcffe50 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.039893:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.039901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:0.0:1789480077.039905:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480077.039909:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789480077.039948:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789480077.040072:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+29:10860:x1876405507904384:12345-192.168.206.44@tcp:36:bash.0 Request processed in 617us (1592us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789480077.040080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 100 00000020:00080000:0.0:1789480077.040085:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789480077.045021:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.045108:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904512 00000100:00100000:2.0:1789480077.045122:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904512 00000100:00100000:2.0:1789480077.045257:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:2.0:1789480077.045270:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+29:10860:x1876405507904512:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480077.045446:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480077.045475:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d934 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bcd expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.045553:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bcd expref: 30 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.045571:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d934 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bcd expref: 30 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.045592:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:2.0:1789480077.045595:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480077.045600:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a000, rc 0) 00000100:00100000:2.0:1789480077.045675:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+30:10860:x1876405507904512:12345-192.168.206.44@tcp:101:bash.0 Request processed in 408us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.045683:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:0.0:1789480077.052543:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.052704:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904640 00000100:00100000:1.0:1789480077.052718:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904640 00000100:00100000:1.0:1789480077.052786:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1789480077.052797:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:10860:x1876405507904640:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480077.052821:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480077.052847:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bd4 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480077.052879:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94c8b, atime: 0x6aa94c8a, ctime: 0x6aa94c8b, blocks: 0x8 00010000:00010000:1.0:1789480077.052907:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1789480077.052920:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480077.052929:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 7 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.052950:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 7 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.052966:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd200, rc 0) 00000100:00100000:1.0:1789480077.053063:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:10860:x1876405507904640:12345-192.168.206.44@tcp:101:bash.0 Request processed in 268us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.053071:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1789480077.055836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.055933:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904768 00000100:00100000:3.0:1789480077.055947:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904768 00002000:00010000:3.0:1789480077.056017:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789480077.056023:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6988805f80 with x1876405507904768 ext(0->18446744073709551615) 00002000:00010000:3.0:1789480077.056040:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6988805f80. 00000100:00100000:3.0:1789480077.056073:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:3.0:1789480077.056085:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507904768:12345-192.168.206.44@tcp:10:bash.0 00002000:00010000:3.0:1789480077.056473:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789480077.056478:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789480075 -> 1789480076 00002000:00010000:3.0:1789480077.056490:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789480074 -> 1789480074 00002000:00010000:3.0:1789480077.056492:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789480075 -> 1789480076 00002000:00010000:3.0:1789480077.056494:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789480077.056572:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507904768:12345-192.168.206.44@tcp:10:bash.0 Request processed in 489us (748us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789480077.056581:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00002000:00010000:3.0:1789480077.056823:0:8440:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1789480077.056827:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6988805f80 with x1876405507904768 ext(0->18446744073709551615) 00002000:00010000:3.0:1789480077.056834:0:8440:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6988805f80. 00000100:00100000:3.0:1789480077.122852:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.123069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507904896 00000100:00100000:1.0:1789480077.123083:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507904896 00000100:00100000:1.0:1789480077.123165:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:1.0:1789480077.123182:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11349:x1876405507904896:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:1.0:1789480077.123363:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123386:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123403:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123421:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123430:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123458:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123553:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123563:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123570:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480077.123641:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123655:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123662:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123669:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123675:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480077.123680:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123689:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123704:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480077.123713:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480077.123720:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123726:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123741:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123746:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123751:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123756:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480077.123758:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123764:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123772:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a87f32100) 00010000:00010000:1.0:1789480077.123775:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480077.123778:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123783:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243d949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123805:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123817:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123823:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123829:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480077.123832:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123838:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123846:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:1.0:1789480077.123849:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480077.123852:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.123858:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d950 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.123963:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11349:x1876405507904896:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 785us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.123973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:0.0:1789480077.141712:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.141761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.141801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.141844:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905152 00000100:00100000:0.0:1789480077.141858:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.141859:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905152 00000100:00100000:0.0:1789480077.141892:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.141924:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905280 00000100:00100000:0.0:1789480077.141929:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905280 00000100:00100000:1.0:1789480077.141957:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905408 00000100:00100000:1.0:1789480077.141962:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905408 00000100:00100000:0.0:1789480077.141985:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:1.0:1789480077.141993:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905536 00000100:00100000:1.0:1789480077.141998:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905536 00000100:00100000:0.0:1789480077.142000:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507905280:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480077.142032:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 321 00000100:00100000:1.0:1789480077.142041:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507905152:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480077.142089:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507905152:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 50us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.142096:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 321 00000100:00100000:1.0:1789480077.142114:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 322 00000100:00100000:1.0:1789480077.142120:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507905408:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480077.142170:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507905280:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 176us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.142177:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:0.0:1789480077.142257:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 323 00000100:00100000:0.0:1789480077.142265:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507905536:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480077.142294:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507905536:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.142300:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 323 00000100:00080000:0.0:1789480077.142320:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480077.142325:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480077.142328:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480077.144993:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905024 00000100:00100000:2.0:1789480077.145017:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905024 00000100:00100000:2.0:1789480077.145103:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 391 00000100:00100000:2.0:1789480077.145116:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507905024:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480077.145293:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507905024:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 179us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.145302:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 391 00000100:00100000:1.0:1789480077.147866:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987c0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507905408:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 5726us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.147884:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 322 00000100:00100000:3.0:1789480077.164973:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.165284:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905792 00000100:00100000:0.0:1789480077.165297:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905792 00000100:00100000:0.0:1789480077.165455:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:0.0:1789480077.165470:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11352:x1876405507905792:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480077.165499:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.165527:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243d957 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bdb expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165624:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165913:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165927:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165948:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165955:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.165962:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166119:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d96c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166129:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166137:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480077.166147:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789480077.166328:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166337:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166344:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166360:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.166365:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166374:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166390:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480077.166393:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.166400:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166406:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d95e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166425:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166432:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166438:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166443:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dba00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.166445:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166451:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166470:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:0.0:1789480077.166472:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.166475:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166481:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166536:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243d957 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bdb expref: 33 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166552:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d96c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bdb expref: 32 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.166560:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:0.0:1789480077.166563:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789480077.166566:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da400, rc 0) 00000100:00100000:0.0:1789480077.166953:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11352:x1876405507905792:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1485us (1991us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789480077.166963:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:3.0:1789480077.169983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.170091:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507905920 00000100:00100000:2.0:1789480077.170104:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507905920 00000100:00100000:2.0:1789480077.170174:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:2.0:1789480077.170187:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11352:x1876405507905920:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1789480077.170341:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.170363:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 32 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.170374:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.170419:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 32 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.170436:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 32 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.170452:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527919104:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480077.170562:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480077.173956:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527919104:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480077.174007:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.176146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.176417:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507906176 00000100:00100000:1.0:1789480077.176429:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507906176 00000100:00100000:1.0:1789480077.176498:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789480077.176509:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+33:6180:x1876405507906176:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480077.177108:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+34:6180:x1876405507906176:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 597us (971us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789480077.177118:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1789480077.179493:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.179941:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507906304 00000100:00100000:1.0:1789480077.179955:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507906304 00010000:00010000:1.0:1789480077.180021:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 34 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.180070:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:1.0:1789480077.180081:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+34:2402:x1876405507906304:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480077.180100:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480077.180123:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 34 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180139:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 34 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180166:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d911 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bbf expref: 34 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180186:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:1.0:1789480077.180247:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180259:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180268:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.180541:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480077.180831:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180842:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180892:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180900:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180907:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180913:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480077.180928:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180936:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180948:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:3.0:1789480077.180951:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480077.180955:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.180961:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243d97a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.181046:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+33:2402:x1876405507906304:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 963us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.181057:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:3.0:1789480077.181597:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11352:x1876405507905920:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 11400us (11627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480077.181611:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:3.0:1789480077.184091:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.184759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507906560 00000100:00100000:1.0:1789480077.184819:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507906560 00000100:00100000:2.0:1789480077.186866:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1789480077.186887:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+32:11352:x1876405507906560:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480077.187285:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+33:11352:x1876405507906560:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 403us (3204us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789480077.187295:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1789480077.293516:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.295302:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507906816 00000100:00100000:0.0:1789480077.295381:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507906816 00000100:00100000:0.0:1789480077.295524:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:0.0:1789480077.295537:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+33:11363:x1876405507906816:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1789480077.295570:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.295610:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d981 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2be2 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295724:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295743:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295756:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295773:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295780:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295786:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295942:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295952:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.295959:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480077.295984:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789480077.296099:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296107:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296121:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296127:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.296132:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296141:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296154:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480077.296158:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.296163:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296169:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296186:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296258:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296264:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296269:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.296271:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296287:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296295:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:0.0:1789480077.296298:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.296312:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296319:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d98f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296374:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be2 expref: 36 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296389:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be2 expref: 35 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.296397:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:0.0:1789480077.296399:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480077.296402:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db200, rc 0) 00000100:00100000:0.0:1789480077.296489:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11363:x1876405507906816:12345-192.168.206.44@tcp:101:cat.0 Request processed in 954us (2986us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789480077.296498:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:0.0:1789480077.306916:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.307183:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907072 00000100:00100000:3.0:1789480077.307243:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907072 00000100:00100000:3.0:1789480077.307318:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1789480077.307330:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11363:x1876405507907072:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:3.0:1789480077.308138:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+36:11363:x1876405507907072:12345-192.168.206.44@tcp:35:cat.0 Request processed in 805us (1232us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789480077.308158:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1789480077.331390:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.331586:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907328 00000100:00100000:0.0:1789480077.331599:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907328 00000100:00100000:0.0:1789480077.331728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:0.0:1789480077.331742:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+36:11364:x1876405507907328:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:0.0:1789480077.331835:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789480077.331871:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243d934 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bcd expref: 36 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.331901:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d996 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be2 expref: 35 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.331916:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243d96c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bdb expref: 34 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.331931:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243d926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bc6 expref: 33 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.331942:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:0.0:1789480077.331948:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480077.331976:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.331992:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332002:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332018:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332026:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332045:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332140:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332163:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332172:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480077.332489:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789480077.332501:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446256310329ns, next at 447256306964ns, rc = 0 00010000:00010000:0.0:1789480077.332564:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332574:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332582:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332589:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332596:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332602:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332642:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480077.332665:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332672:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332678:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332685:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.332689:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332698:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332707:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:0.0:1789480077.332711:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789480077.332715:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332722:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243d9b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332741:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332748:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332754:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332765:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dba00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.332768:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332775:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332784:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480077.332786:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.332789:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332795:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243d9a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480077.332805:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf4b0c8b reply state 00000000492f5b23 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332817:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.332823:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:0.0:1789480077.332825:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480077.332828:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480077.332923:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+34:11364:x1876405507907328:12345-192.168.206.44@tcp:36:rm.0 Request processed in 1182us (1546us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789480077.332931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00010000:00010000:1.0:1789480077.333006:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480077.333014:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.333021:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480077.333024:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.333038:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.333048:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:1.0:1789480077.333050:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789480077.333053:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.333059:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243d9b9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.333071:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480077.333073:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480077.333075:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480077.412880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.412972:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907584 00000100:00100000:3.0:1789480077.412986:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907584 00000100:00100000:3.0:1789480077.413074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:3.0:1789480077.413087:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+34:11370:x1876405507907584:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480077.413133:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480077.413158:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d9c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2be9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413348:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413366:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413379:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413393:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413401:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.413408:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480077.414007:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789480077.414401:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414415:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414425:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414478:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414486:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414494:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414501:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480077.414506:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414514:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414861:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480077.414865:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480077.414872:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414879:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243d9c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480077.414898:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f1ff429 reply state 00000000349f8685 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414911:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414917:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:3.0:1789480077.414926:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480077.414930:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789480077.414968:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243d9c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 37 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414984:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.414992:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:3.0:1789480077.414994:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480077.414997:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030400, rc 0) 00000100:00100000:3.0:1789480077.415264:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+37:11370:x1876405507907584:12345-192.168.206.44@tcp:101:bash.0 Request processed in 2178us (2398us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789480077.415274:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:3.0:1789480077.418882:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.421415:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907712 00000100:00100000:1.0:1789480077.421437:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907712 00000100:00100000:1.0:1789480077.421566:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1789480077.421593:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2400:x1876405507907712:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480077.421617:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480077.421643:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bf0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480077.421675:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480077.421701:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789480077.421706:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480077.421717:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.421766:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.421781:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd800, rc 0) 00000100:00100000:1.0:1789480077.421862:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2400:x1876405507907712:12345-192.168.206.44@tcp:101:bash.0 Request processed in 287us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.421869:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1789480077.426617:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.431807:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907840 00000100:00100000:0.0:1789480077.431828:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907840 00000100:00100000:0.0:1789480077.431991:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1789480077.432023:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:11370:x1876405507907840:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480077.432047:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.432071:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bf7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.432114:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.432223:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480077.432229:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480077.432237:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.432284:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.432301:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480077.432319:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876405527919232:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480077.432738:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480077.436022:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1876405527919232:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480077.436071:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.436135:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:0.0:1789480077.436259:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:11370:x1876405507907840:12345-192.168.206.44@tcp:101:bash.0 Request processed in 4238us (9654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.436268:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:3.0:1789480077.436602:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.436904:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507907968 00000100:00100000:1.0:1789480077.436914:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507907968 00010000:00010000:1.0:1789480077.436958:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.437000:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789480077.437010:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507907968:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480077.437026:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480077.437055:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.437071:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.437099:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c21f68/0xdaa289fda243d9e3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf0 expref: 9 pid: 8493 timeout: 546 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.437143:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480077.437148:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480077.437159:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.437169:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.437315:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.437343:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876405527919360:192.168.206.44@tcp:105: 00000100:00100000:1.0:1789480077.437436:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b540 going to sleep for 11 seconds 00000100:00100000:1.0:1789480077.439762:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988804e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876405527919360:192.168.206.44@tcp:105: 00010000:00010000:1.0:1789480077.439796:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480077.439861:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507907968:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 2851us (3259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.439874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789480077.445692:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.446094:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507908224 00000100:00100000:2.0:1789480077.446108:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507908224 00000100:00100000:2.0:1789480077.446187:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1789480077.446256:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+37:11370:x1876405507908224:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:2.0:1789480077.446798:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11370:x1876405507908224:12345-192.168.206.44@tcp:35:bash.0 Request processed in 545us (1132us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789480077.446807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1789480077.619832:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.620169:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507908352 00000100:00100000:1.0:1789480077.620182:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507908352 00000100:00100000:1.0:1789480077.620310:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 108 00000100:00100000:1.0:1789480077.620322:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+38:11386:x1876405507908352:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480077.620353:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480077.620400:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d9f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2bfe expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620495:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620513:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620527:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480077.620591:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1789480077.620596:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480077.620620:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620652:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243d9f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bfe expref: 40 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620673:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bfe expref: 39 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.620682:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:1.0:1789480077.620685:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480077.620689:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd000, rc 0) 00000100:00100000:1.0:1789480077.620775:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+39:11386:x1876405507908352:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 455us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.620784:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 108 00000100:00100000:2.0:1789480077.631788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.631906:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507908608 00000100:00100000:0.0:1789480077.631918:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507908608 00000100:00100000:0.0:1789480077.632250:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 109 00000100:00100000:0.0:1789480077.632264:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+39:11386:x1876405507908608:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480077.632292:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.632322:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d9ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c05 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.632459:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243da06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.632476:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243da06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.632491:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243da06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480077.632503:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789480077.632637:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243d9ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c05 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.632659:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243da06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c05 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.632684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:0.0:1789480077.632687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480077.632692:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da400, rc 0) 00000100:00100000:0.0:1789480077.632769:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+41:11386:x1876405507908608:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 509us (996us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789480077.632778:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 109 00000100:00100000:3.0:1789480077.636182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.636606:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507908736 00000100:00100000:2.0:1789480077.636620:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507908736 00000100:00100000:2.0:1789480077.636695:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480077.636707:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+41:2401:x1876405507908736:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480077.636728:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480077.636759:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243da06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c05 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.636784:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:2.0:1789480077.636790:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480077.636847:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+40:2401:x1876405507908736:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 143us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.636855:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00010000:00010000:2.0:1789480077.637860:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480077.655839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.656039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507908992 00000100:00100000:2.0:1789480077.656052:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507908992 00000100:00100000:2.0:1789480077.656143:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00100000:2.0:1789480077.656156:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+40:11386:x1876405507908992:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480077.656268:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480077.656296:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c0c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.656446:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.656464:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.656478:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480077.656493:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789480077.656629:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c0c expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.656653:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c0c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.656664:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:2.0:1789480077.656668:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480077.656672:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789480077.656749:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+42:11386:x1876405507908992:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 596us (924us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789480077.656758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 110 00000100:00100000:2.0:1789480077.673481:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.674667:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909120 00000100:00100000:3.0:1789480077.674685:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909120 00000100:00100000:3.0:1789480077.674779:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1789480077.674791:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2400:x1876405507909120:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:3.0:1789480077.674865:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.674891:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.674924:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480077.674929:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480077.674935:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.674996:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.675021:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 8 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.675038:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527919488:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480077.675372:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480077.685096:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.685301:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909248 00000100:00100000:3.0:1789480077.685313:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909248 00002000:00100000:3.0:1789480077.685372:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a6abb02d500 x1876405507909248/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:228/0 lens 504/0 e 0 to 0 dl 1789480088 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480077.685385:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb02d500 with x1876405507909248 ext(0->8) 00010000:00010000:3.0:1789480077.685396:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 9 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.685426:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 9 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480077.685435:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6abb02d500 00000100:00100000:3.0:1789480077.685490:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:3.0:1789480077.685500:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507909248:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:3.0:1789480077.689005:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2402:x1876405507909248:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 3490us (3905us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789480077.689028:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00002000:00100000:3.0:1789480077.689043:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a6abb02d500 x1876405507909248/t4294967303(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:228/0 lens 504/448 e 0 to 0 dl 1789480088 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480077.689054:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb02d500 with x1876405507909248 ext(0->8) 00010000:00010000:3.0:1789480077.689067:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.689091:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480077.689100:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6abb02d500 00000100:00100000:0.0:1789480077.689462:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527919488:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480077.689510:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.693888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.697287:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909376 00000100:00100000:2.0:1789480077.697331:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909376 00010000:00010000:2.0:1789480077.697400:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.699998:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:2.0:1789480077.700140:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2400:x1876405507909376:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480077.700170:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789480077.700228:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789480077.700232:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789480077 00002000:00010000:2.0:1789480077.700235:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789480077 00002000:00010000:2.0:1789480077.700237:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789480077 00002000:00010000:2.0:1789480077.700239:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789480077.700249:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.700270:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.700300:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243d9ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bf7 expref: 11 pid: 8435 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.700323:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480077.700328:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480077.700335:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.700346:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.700949:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480077.701065:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2400:x1876405507909376:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 945us (7188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.701076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00010000:00010000:3.0:1789480077.705323:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705349:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705390:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705400:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705768:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705776:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480077.705781:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705792:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705818:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.705826:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ff9384/0xdaa289fda243da29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.706286:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2400:x1876405507909120:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 31490us (32812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480077.706299:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1789480077.716749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.720647:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909632 00000100:00100000:1.0:1789480077.720693:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909632 00000100:00100000:1.0:1789480077.720785:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:1.0:1789480077.720798:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+42:11386:x1876405507909632:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:1.0:1789480077.720884:0:14183:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c0c expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480077.725875:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1789480077.725930:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789480077.728398:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1789480077.728487:0:14183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.728514:0:14183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.728539:0:14183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.729406:0:14183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480077.729432:0:14183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 46 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480077.729451:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988806300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527919616:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480077.730385:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480077.735887:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988806300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527919616:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480077.735889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00010000:00010000:3.0:1789480077.735930:0:14183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.736104:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909760 00000100:00100000:2.0:1789480077.736113:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909760 00010000:00010000:2.0:1789480077.736330:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 47 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.736371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:2.0:1789480077.736382:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+47:2401:x1876405507909760:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480077.736401:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480077.736471:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 47 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.736488:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 47 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.737339:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243d9d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2be9 expref: 47 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.737373:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:2.0:1789480077.737380:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.737394:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.737435:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.737481:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480077.737563:0:14183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.737591:0:14183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.737637:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+46:2401:x1876405507909760:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 1252us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480077.737649:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000001:00080000:3.0:1789480077.737743:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789480077.737912:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789480077.738373:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527919744:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789480077.738445:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480077.738495:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480077.738644:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527919744 00000100:00100000:1.0:1789480077.738654:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527919744 00000100:00100000:1.0:1789480077.738725:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789480077.738737:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527919744:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789480077.739249:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527919744:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 513us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480077.739258:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789480077.739375:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527919744:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1789480077.739541:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789480077.739681:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527919872:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789480077.739715:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480077.739744:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f780 going to sleep for 11 seconds 00000100:00100000:1.0:1789480077.740217:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527919872 00000100:00100000:1.0:1789480077.740225:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527919872 00000100:00100000:1.0:1789480077.740266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789480077.740275:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527919872:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789480077.740417:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14183:x1876405527919872:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 143us (701us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789480077.740425:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789480077.741871:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a9f4b9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527919872:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1789480077.741975:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789480077.742043:0:14183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742057:0:14183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742067:0:14183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742074:0:14183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480077.742080:0:14183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742089:0:14183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742109:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:2.0:1789480077.742113:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789480077.742118:0:14183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.742149:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243da30 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480077.742328:0:14183:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789480077.742420:0:14183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789480077.742435:0:14183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 446666244083ns, next at 447666241428ns, rc = 0 00000001:00080000:2.0:1789480077.742442:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789480077.742472:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:2.0:1789480077.742476:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480077.742484:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c0c expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.742705:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+49:11386:x1876405507909632:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 21907us (25968us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789480077.742716:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000020:00080000:2.0:1789480077.742723:0:14183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789480077.749032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.750673:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507909888 00000100:00100000:0.0:1789480077.750693:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507909888 00000100:00100000:0.0:1789480077.750839:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00100000:0.0:1789480077.750853:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+49:11386:x1876405507909888:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480077.750885:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.750916:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243da37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c13 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.750993:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243da37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c13 expref: 50 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.751011:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243da37 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c13 expref: 50 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.751030:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480077.751051:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480077.751056:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dbc00, rc 0) 00000100:00100000:0.0:1789480077.751128:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+50:11386:x1876405507909888:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 279us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.751135:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 111 00000100:00100000:0.0:1789480077.757856:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.757985:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507910144 00000100:00100000:1.0:1789480077.757998:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507910144 00000100:00100000:1.0:1789480077.758081:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1789480077.758092:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+50:11386:x1876405507910144:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1789480077.758467:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+51:11386:x1876405507910144:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 375us (625us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789480077.758476:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:3.0:1789480077.835869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.836090:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507910272 00000100:00100000:0.0:1789480077.836104:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507910272 00000100:00100000:0.0:1789480077.836185:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 112 00000100:00100000:0.0:1789480077.836314:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+51:11396:x1876405507910272:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:0.0:1789480077.836415:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836438:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836452:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836465:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836473:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836480:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836577:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836609:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836617:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480077.836680:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836696:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836704:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836712:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836719:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.836725:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836733:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836747:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480077.836751:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.836757:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243da3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836788:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836795:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836802:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836808:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.836811:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836817:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836825:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:0.0:1789480077.836827:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.836831:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836836:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836846:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836853:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836859:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836871:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.836874:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836881:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836889:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480077.836891:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480077.836894:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.836899:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480077.837008:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+51:11396:x1876405507910272:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 721us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.837017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 112 00000100:00100000:0.0:1789480077.885252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.885527:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507910528 00000100:00100000:2.0:1789480077.885541:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507910528 00000100:00100000:2.0:1789480077.885626:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:2.0:1789480077.885638:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+51:11399:x1876405507910528:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480077.885666:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480077.885694:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da53 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c1a expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885795:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885814:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885849:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885863:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885872:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.885879:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886050:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886059:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886067:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480077.886078:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789480077.886176:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886184:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886235:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886241:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480077.886253:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886262:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886276:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480077.886280:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480077.886285:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886292:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243da5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886310:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886316:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886322:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886328:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480077.886330:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886336:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886343:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:2.0:1789480077.886345:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480077.886355:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886361:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886406:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da53 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886421:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.886428:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480077.886431:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480077.886434:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789480077.886522:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11399:x1876405507910528:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 885us (1284us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789480077.886533:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 113 00000100:00100000:1.0:1789480077.892899:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.893023:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507910656 00000100:00100000:0.0:1789480077.893036:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507910656 00000100:00100000:0.0:1789480077.893114:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:0.0:1789480077.893128:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11399:x1876405507910656:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:0.0:1789480077.893261:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893283:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893321:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893366:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893374:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893381:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893387:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480077.893392:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893399:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893413:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480077.893415:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480077.893420:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.893426:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480077.893521:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11399:x1876405507910656:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 397us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.893530:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 114 00000100:00100000:3.0:1789480077.896305:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.896469:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507910912 00000100:00100000:2.0:1789480077.896483:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507910912 00000100:00100000:2.0:1789480077.896553:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1789480077.896566:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+53:11399:x1876405507910912:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480077.896896:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11399:x1876405507910912:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 331us (603us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789480077.896904:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:1.0:1789480077.957161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480077.957532:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911168 00000100:00100000:2.0:1789480077.957545:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911168 00000100:00100000:2.0:1789480077.957634:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:2.0:1789480077.957648:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11409:x1876405507911168:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480077.957700:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480077.957703:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789480077.957739:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243d9f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bfe expref: 54 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.957771:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480077.957778:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480077.957795:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c21 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.957928:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.957946:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.957956:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.958012:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.958029:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 54 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.958046:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb02ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920000:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480077.958749:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480077.962688:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.962790:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911296 00000100:00100000:3.0:1789480077.962803:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911296 00010000:00010000:3.0:1789480077.962857:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 55 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.962914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:3.0:1789480077.962926:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+55:2401:x1876405507911296:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480077.962945:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480077.962952:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 55 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.963002:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 55 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.963030:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480077.963036:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.963049:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.963057:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.963079:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480077.963149:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+55:2401:x1876405507911296:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 224us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480077.963158:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00010000:00010000:2.0:1789480077.964066:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243da68 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c1a expref: 54 pid: 6520 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480077.964111:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb02ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920000:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480077.964141:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.964151:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.964158:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480077.964187:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789480077.964410:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243da7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 55 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.964428:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 54 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480077.964437:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480077.964440:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480077.964443:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a600, rc 0) 00000100:00100000:2.0:1789480077.964515:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11409:x1876405507911168:12345-192.168.206.44@tcp:101:bash.0 Request processed in 6869us (7366us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789480077.964524:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:1.0:1789480077.968720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.968834:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911424 00000100:00100000:0.0:1789480077.968865:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911424 00000100:00100000:0.0:1789480077.968945:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:0.0:1789480077.968957:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+54:11409:x1876405507911424:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480077.968999:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.969025:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c28 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969068:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969086:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969099:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969293:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243da92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 56 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969315:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 55 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.969324:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480077.969327:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480077.969331:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da800, rc 0) 00000100:00100000:0.0:1789480077.969405:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+55:11409:x1876405507911424:12345-192.168.206.44@tcp:101:bash.0 Request processed in 450us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.969413:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:1.0:1789480077.973715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.973873:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911680 00000100:00100000:3.0:1789480077.973887:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911680 00000100:00100000:3.0:1789480077.973964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:3.0:1789480077.973981:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+55:11409:x1876405507911680:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:3.0:1789480077.974353:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.974374:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.974386:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480077.974456:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789480077.974483:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c56bee3c reply state 00000000eb40dfeb transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.974497:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.974507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480077.974511:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480077.974516:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480077.974621:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11409:x1876405507911680:12345-192.168.206.44@tcp:36:bash.0 Request processed in 642us (918us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789480077.974630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000020:00080000:3.0:1789480077.974635:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789480077.978090:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480077.978277:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911808 00000100:00100000:0.0:1789480077.978304:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911808 00000100:00100000:0.0:1789480077.978369:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:0.0:1789480077.978381:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11409:x1876405507911808:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480077.978411:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480077.978435:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243daa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c2f expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.978540:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.978556:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.978566:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.978616:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.978630:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 59 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480077.978645:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920128:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480077.978738:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480077.982550:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480077.982677:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507911936 00000100:00100000:3.0:1789480077.982691:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507911936 00010000:00010000:3.0:1789480077.982740:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 60 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480077.982800:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:3.0:1789480077.982811:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+60:2401:x1876405507911936:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480077.982828:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480077.982837:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 60 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.982851:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 60 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.982891:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480077.982897:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.982908:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.982917:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480077.982940:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480077.983023:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+60:2401:x1876405507911936:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 213us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480077.983030:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00010000:00010000:0.0:1789480077.983280:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243da84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c21 expref: 59 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480077.983301:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920128:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480077.983336:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.983347:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.983353:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480077.983420:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789480077.983425:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480077.983450:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.983486:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243daa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.983506:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 58 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480077.983514:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480077.983517:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480077.983520:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dac00, rc 0) 00000100:00100000:0.0:1789480077.983551:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11409:x1876405507911808:12345-192.168.206.44@tcp:101:bash.0 Request processed in 5174us (5477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480077.983558:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:3.0:1789480077.986810:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480077.987083:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912192 00000100:00100000:1.0:1789480077.987095:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912192 00000100:00100000:1.0:1789480077.987165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:1.0:1789480077.987178:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:11409:x1876405507912192:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1789480077.987505:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11409:x1876405507912192:12345-192.168.206.44@tcp:35:bash.0 Request processed in 329us (707us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789480077.987513:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:1.0:1789480078.047186:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.047343:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912320 00000100:00100000:0.0:1789480078.047356:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912320 00000100:00100000:0.0:1789480078.047429:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:0.0:1789480078.047441:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+59:11415:x1876405507912320:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480078.047489:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480078.047517:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c36 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047614:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047632:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047647:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480078.047705:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789480078.047709:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480078.047733:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047764:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c36 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047789:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c36 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.047800:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480078.047803:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480078.047807:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da000, rc 0) 00000100:00100000:0.0:1789480078.047885:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507912320:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 446us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.047893:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:0.0:1789480078.052464:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.052706:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912448 00000100:00100000:2.0:1789480078.052719:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912448 00000100:00100000:2.0:1789480078.052810:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:2.0:1789480078.052841:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507912448:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480078.052870:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480078.052897:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dac3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c3d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053148:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053180:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053240:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053249:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053257:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053350:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053360:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053368:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480078.053434:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789480078.053439:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480078.053464:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053477:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053486:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053493:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053499:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053505:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047aa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.053510:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053517:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053530:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480078.053533:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.053540:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053546:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243daca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053572:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053699:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053705:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053711:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.053713:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053719:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053727:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:2.0:1789480078.053730:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.053734:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053739:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dad1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053833:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dac3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c3d expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053849:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c3d expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.053869:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.053871:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480078.053875:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a000, rc 0) 00000100:00100000:2.0:1789480078.053962:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11415:x1876405507912448:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1124us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.055058:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:1.0:1789480078.059454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.059509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.059719:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912832 00000100:00100000:3.0:1789480078.059732:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912832 00000100:00100000:3.0:1789480078.059828:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1789480078.059841:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:2402:x1876405507912832:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480078.059863:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480078.059895:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dad8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c3d expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.059920:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480078.059926:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480078.060009:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:2402:x1876405507912832:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 169us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.060039:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1789480078.060308:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912704 00000100:00100000:0.0:1789480078.060313:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912704 00000100:00100000:0.0:1789480078.060364:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:0.0:1789480078.060373:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507912704:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480078.060394:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480078.060413:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dadf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c44 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.060560:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.060576:0:12158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 61 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.060584:0:12158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.060623:0:12158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 61 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.060637:0:12158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 61 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.060652:0:12158:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920256:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480078.060734:0:12158:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480078.068418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.069625:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507912960 00000100:00100000:3.0:1789480078.069640:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507912960 00010000:00010000:3.0:1789480078.069697:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 62 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.069752:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:3.0:1789480078.069774:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:2401:x1876405507912960:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480078.069793:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480078.069801:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 62 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.069816:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 62 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.069845:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480078.069851:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.069862:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.069870:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.069894:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480078.069957:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:2401:x1876405507912960:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 195us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.070004:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00010000:00010000:0.0:1789480078.072801:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243daae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c2f expref: 61 pid: 12158 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.072865:0:12158:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12158:1876405527920256:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480078.072897:0:12158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.072909:0:12158:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.072915:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480078.072945:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789480078.073309:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dadf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 62 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.073328:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 61 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.073338:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480078.073341:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789480078.073345:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db600, rc 0) 00000100:00100000:0.0:1789480078.073500:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11415:x1876405507912704:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 13126us (14058us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789480078.073510:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:1.0:1789480078.076864:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.076965:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913216 00000100:00100000:3.0:1789480078.076977:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913216 00000100:00100000:3.0:1789480078.077155:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1789480078.077169:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11415:x1876405507913216:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:3.0:1789480078.077230:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480078.077261:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243da37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c13 expref: 61 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.077284:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480078.077290:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480078.077353:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507913216:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 187us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.077360:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1789480078.080107:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.080393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913344 00000100:00100000:3.0:1789480078.080406:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913344 00000100:00100000:2.0:1789480078.080755:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:2.0:1789480078.080779:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507913344:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:2.0:1789480078.080947:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.080981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.080998:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480078.081127:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789480078.081503:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507913344:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 736us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.081511:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:3.0:1789480078.084009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.089648:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913472 00000100:00100000:1.0:1789480078.089664:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913472 00000100:00100000:1.0:1789480078.089767:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:1.0:1789480078.089782:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+60:11415:x1876405507913472:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480078.089812:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480078.089839:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c4b expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.089910:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.089921:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 61 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.089943:0:8915:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.089981:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 61 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.089998:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:1.0:1789480078.090002:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480078.090007:0:8915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 61 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.090016:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc800, rc 0) 00000100:00100000:1.0:1789480078.090095:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11415:x1876405507913472:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 318us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.090102:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000040:00080000:0.0:1789480078.277543:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480078.277558:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480078.278078:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789480078.278296:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480078.278534:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d70700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527920384:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480078.278941:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480078.284125:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.284314:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913600 00000100:00100000:2.0:1789480078.284328:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913600 00000100:00100000:2.0:1789480078.284418:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:2.0:1789480078.284430:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507913600:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480078.284493:0:12158:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480078.284673:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507913600:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 245us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.284681:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:3.0:1789480078.289592:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.294325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913728 00000100:00100000:2.0:1789480078.294348:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913728 00000100:00100000:2.0:1789480078.294458:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:2.0:1789480078.294472:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507913728:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.294597:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294620:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294634:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294652:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294659:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294665:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294708:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294718:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294745:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480078.294808:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789480078.294813:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480078.294829:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294841:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294848:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294855:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294861:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047aa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.294866:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294875:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294888:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:2.0:1789480078.294891:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.294898:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294904:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294935:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294941:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294946:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294951:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047bc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.294954:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294960:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8a6987bf1a00) 00010000:00010000:2.0:1789480078.294970:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.294972:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294978:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db09 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.294998:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295003:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295008:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295019:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.295023:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295028:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.295039:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.295053:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.295060:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.296925:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507913728:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 2440us (7403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.296942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:0.0:1789480078.298455:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d70700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527920384:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789480078.302324:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.306286:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507913984 00000100:00100000:0.0:1789480078.306307:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507913984 00000100:00100000:0.0:1789480078.306432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:0.0:1789480078.306443:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:11416:x1876405507913984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480078.306472:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480078.306500:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c52 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306663:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306683:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306708:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480078.306722:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789480078.306826:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306834:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306841:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306870:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.306876:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306884:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306898:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480078.306900:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789480078.306906:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306913:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306976:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db17 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c52 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.306988:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:0.0:1789480078.306990:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480078.306994:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c52 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.307005:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da600, rc 0) 00000100:00100000:0.0:1789480078.307112:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987face00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507913984:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 670us (4923us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1789480078.307118:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:3.0:1789480078.314145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.314440:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507914112 00000100:00100000:1.0:1789480078.314453:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507914112 00000100:00100000:1.0:1789480078.314523:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:1.0:1789480078.314535:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507914112:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789480078.314581:0:8915:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789480078.314732:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507914112:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 198us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.314739:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:3.0:1789480078.327514:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.327705:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507914368 00000100:00100000:2.0:1789480078.327720:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507914368 00000100:00100000:2.0:1789480078.327800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:2.0:1789480078.327813:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507914368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.327841:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480078.327845:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789480078.327880:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243dabc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c36 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.327906:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:2.0:1789480078.327931:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480078.327949:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c59 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480078.329405:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789480078.329846:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.329868:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.329881:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.329961:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243db2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c59 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.330357:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c59 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.330368:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:2.0:1789480078.330372:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480078.330377:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789480078.330477:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11416:x1876405507914368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2666us (2977us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789480078.330487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:3.0:1789480078.335271:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.335380:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507914624 00000100:00100000:0.0:1789480078.335410:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507914624 00000100:00100000:0.0:1789480078.335497:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:0.0:1789480078.335509:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11416:x1876405507914624:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480078.335588:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480078.335624:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243db33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c59 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335648:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:0.0:1789480078.335661:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480078.335688:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335705:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335717:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335733:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335741:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335748:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335803:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335810:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335824:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335831:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.335835:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335845:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335853:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480078.335856:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480078.335861:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335867:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243db41 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335879:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335886:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335891:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335896:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.335898:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335915:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335923:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd2050776 (ffff8a6a8be16500) 00010000:00010000:0.0:1789480078.335925:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480078.335929:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.335935:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243db48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd2050776 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.341900:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507914624:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 6374us (6624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480078.341919:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:2.0:1789480078.345918:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.346244:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507914752 00000100:00100000:3.0:1789480078.346259:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507914752 00000100:00100000:3.0:1789480078.346332:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:3.0:1789480078.346345:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+62:11416:x1876405507914752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480078.346390:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480078.346420:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243db4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c60 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346466:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346482:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346495:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346923:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243db4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346948:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.346957:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:3.0:1789480078.346960:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480078.347033:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030400, rc 0) 00000100:00100000:3.0:1789480078.347351:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11416:x1876405507914752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.347359:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:1.0:1789480078.351916:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.352052:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915008 00000100:00100000:2.0:1789480078.352066:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915008 00000100:00100000:2.0:1789480078.352167:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1789480078.352179:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+63:11416:x1876405507915008:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.352344:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.352365:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.352380:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480078.352590:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1789480078.352601:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 447276409554ns, next at 448276406244ns, rc = 0 00000004:00010000:2.0:1789480078.352654:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6eae110 reply state 00000000d28f6b5f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.352667:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.352675:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:2.0:1789480078.352678:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789480078.352684:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480078.352808:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11416:x1876405507915008:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 630us (904us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789480078.352815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:2.0:1789480078.358240:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.358396:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915136 00000100:00100000:1.0:1789480078.358409:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915136 00000100:00100000:1.0:1789480078.358485:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:1.0:1789480078.358498:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:11416:x1876405507915136:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480078.358560:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480078.358602:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c67 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.358675:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 66 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.358692:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 66 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.358726:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480078.358729:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480078.358734:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bcc00, rc 0) 00000100:00100000:1.0:1789480078.358808:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11416:x1876405507915136:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 313us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.358817:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:0.0:1789480078.369780:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.369907:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915264 00000100:00100000:2.0:1789480078.369921:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915264 00000100:00100000:2.0:1789480078.370009:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:2.0:1789480078.370022:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507915264:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789480078.370370:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507915264:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 350us (604us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789480078.370379:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00080000:0.0:1789480078.370454:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480078.378500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.378940:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915520 00000100:00100000:0.0:1789480078.378952:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915520 00000100:00100000:0.0:1789480078.379034:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:0.0:1789480078.379047:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+66:11416:x1876405507915520:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480078.379393:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+67:11416:x1876405507915520:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 348us (908us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789480078.379401:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1789480078.384504:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.384676:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915776 00000100:00100000:3.0:1789480078.384689:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915776 00000100:00100000:3.0:1789480078.385389:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:3.0:1789480078.385420:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+67:11416:x1876405507915776:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789480078.385602:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+67:11416:x1876405507915776:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 185us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.385610:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:2.0:1789480078.392866:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.393083:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507915904 00000100:00100000:1.0:1789480078.393096:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507915904 00000100:00100000:1.0:1789480078.393171:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:1.0:1789480078.393184:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+67:11416:x1876405507915904:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480078.393270:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480078.393297:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243db6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c6e expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393386:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393426:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393441:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480078.393665:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480078.393692:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393726:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243db6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c6e expref: 69 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393749:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c6e expref: 68 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.393758:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480078.393762:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789480078.393767:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc600, rc 0) 00000100:00100000:1.0:1789480078.393850:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+68:11416:x1876405507915904:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 668us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.393858:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:1.0:1789480078.397713:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.397872:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916032 00000100:00100000:2.0:1789480078.397885:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916032 00000100:00100000:2.0:1789480078.397957:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:2.0:1789480078.397979:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507916032:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.398004:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480078.398029:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c75 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480078.398062:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c8e, blocks: 0x0 00010000:00010000:2.0:1789480078.398088:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=447s v=(0 0) 00010000:00010000:2.0:1789480078.398093:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480078.398104:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 10 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.398127:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 10 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.398143:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047bc00, rc 0) 00000100:00100000:2.0:1789480078.398311:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2402:x1876405507916032:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 334us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.398320:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1789480078.412428:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.412565:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916288 00000100:00100000:2.0:1789480078.412578:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916288 00000100:00100000:2.0:1789480078.412662:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:2.0:1789480078.412675:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+68:11416:x1876405507916288:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789480078.421507:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987faed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+68:11416:x1876405507916288:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 8269us (8526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.421530:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:0.0:1789480078.431792:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.431905:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916416 00000100:00100000:2.0:1789480078.431919:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916416 00000100:00100000:2.0:1789480078.431997:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:2.0:1789480078.432010:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+10:11416:x1876405507916416:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.432034:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480078.432057:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c7c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.432098:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.432109:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480078.432115:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480078.432121:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.432165:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.432420:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.432438:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987f64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527920512:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480078.432605:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480078.437610:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987f64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527920512:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480078.437662:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.437691:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789480078.437777:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+11:11416:x1876405507916416:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 5769us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.437788:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1789480078.439013:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.439274:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916544 00000100:00100000:1.0:1789480078.439286:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916544 00010000:00010000:1.0:1789480078.439340:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.439404:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:1.0:1789480078.439415:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2400:x1876405507916544:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480078.439434:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480078.439481:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.439497:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.439526:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6dc9910/0xdaa289fda243db79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c75 expref: 11 pid: 8493 timeout: 547 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.439546:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480078.439551:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480078.439562:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.439575:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.439622:0:9525:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.439639:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9525:1876405527920640:192.168.206.44@tcp:105: 00000100:00100000:1.0:1789480078.445736:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a698755b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480078.453525:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9525:1876405527920640:192.168.206.44@tcp:105: 00010000:00010000:1.0:1789480078.453559:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480078.453639:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2400:x1876405507916544:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 14225us (14633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.453652:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:0.0:1789480078.458617:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.458729:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916672 00000100:00100000:3.0:1789480078.458744:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916672 00002000:00100000:3.0:1789480078.458812:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a6987d73100 x1876405507916672/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:229/0 lens 504/0 e 0 to 0 dl 1789480089 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480078.458825:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6987d73100 with x1876405507916672 ext(0->12) 00002000:00010000:3.0:1789480078.458832:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6987d73100 00000100:00100000:3.0:1789480078.458875:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:3.0:1789480078.458886:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2401:x1876405507916672:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789480078.460305:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+12:2401:x1876405507916672:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 1411us (1693us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789480078.460320:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00002000:00100000:3.0:1789480078.460332:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a6987d73100 x1876405507916672/t4294967309(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:229/0 lens 504/448 e 0 to 0 dl 1789480089 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480078.460343:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6987d73100 with x1876405507916672 ext(0->12) 00002000:00010000:3.0:1789480078.460350:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6987d73100 00000100:00100000:2.0:1789480078.466350:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.467121:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916800 00000100:00100000:3.0:1789480078.467136:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916800 00000100:00100000:3.0:1789480078.467747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:3.0:1789480078.467761:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+68:11416:x1876405507916800:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789480078.474348:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789480078.474372:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789480078.474454:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789480078.474489:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6a87f1f480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789480078.474496:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a99147900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a6a87f1f840 00000020:00080000:0.0:1789480078.474500:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a99147300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6986b6ba00 00010000:00010000:2.0:1789480078.474532:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789480078.474532:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1789480078.474549:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474558:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474566:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474572:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480078.474579:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a698755ba80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789480078.474587:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b6cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a698755bcc0 00000020:00080000:0.0:1789480078.474595:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b6c500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6987e8dc00 00010000:00010000:2.0:1789480078.474598:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480078.474618:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1789480078.474621:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a6a8be16800) 00010000:00010000:2.0:1789480078.474626:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.474633:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474641:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243d885 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474678:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474685:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474690:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474695:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474698:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474705:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474714:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a6a87f32f00) 00010000:00010000:2.0:1789480078.474717:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.474720:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474737:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243d92d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474756:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474764:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474770:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474775:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474778:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474785:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474792:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:2.0:1789480078.474796:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.474799:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474805:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243d9ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474816:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474823:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474838:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474844:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474847:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474854:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474864:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6a8be16c00) 00010000:00010000:2.0:1789480078.474866:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.474870:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474877:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243d9ce lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.474896:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527920896:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789480078.474896:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474910:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474916:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474921:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474924:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474940:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474950:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.474952:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.474956:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474961:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243daa0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474974:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474979:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474985:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474990:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.474992:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.474998:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.475006:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:2.0:1789480078.475009:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789480078.475011:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.475026:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db5d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789480078.475051:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789480078.475135:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789480078.475411:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480078.475453:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11416:x1876405507916800:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 7690us (9112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.475464:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:3.0:1789480078.475472:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480078.475482:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527920768:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789480078.475512:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480078.475546:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527920896 00000100:00100000:3.0:1789480078.475555:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527920896 00000100:00100000:3.0:1789480078.475608:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527920768 00000100:00100000:3.0:1789480078.475612:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527920768 00000100:00100000:3.0:1789480078.475636:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789480078.475646:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527920896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789480078.476822:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789480078.476830:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789480078 00002000:00010000:3.0:1789480078.476833:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789480078.476835:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789480078 -> 1789480078 00002000:00010000:3.0:1789480078.476837:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789480078.476917:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1876405527920896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1270us (1505us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789480078.476927:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789480078.476955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789480078.476965:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527920768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789480078.476986:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1789480078.477007:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.477031:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 11 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.477057:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789480078.477062:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480078.477068:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.477101:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 11 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.477118:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 11 pid: 8493 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.477134:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527921152:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480078.477322:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480078.477333:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1789480078.477350:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480078.477442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527921024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789480078.477484:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789480078.478275:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a698892ea00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789480078.478287:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527920896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789480078.481324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527921024 00000100:00100000:2.0:1789480078.481417:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.481529:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.481556:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917056 00000100:00100000:2.0:1789480078.481567:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917056 00000100:00100000:3.0:1789480078.481603:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527921024 00010000:00010000:2.0:1789480078.481626:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 12 pid: 8493 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.481662:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507916928 00000100:00100000:3.0:1789480078.481666:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507916928 00000100:00100000:2.0:1789480078.481673:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 74 00000100:00100000:2.0:1789480078.481687:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:2401:x1876405507917056:12345-192.168.206.44@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789480078.481688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789480078.481701:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3648:x1876405527921024:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789480078.481711:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480078.481720:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 13 pid: 8493 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.481738:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 13 pid: 8493 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789480078.481746:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:3.0:1789480078.481794:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa94c8d, atime: 0x6aa94c8d, ctime: 0x6aa94c8d, blocks: 0x8 00010000:00010000:3.0:1789480078.481803:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.481803:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480078.481812:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480078.481820:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.481843:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.481847:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=447s v=(0 0) 00010000:00010000:3.0:1789480078.481855:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480078.481862:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.481877:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480078.481879:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.481891:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.481900:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.481919:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480078.481950:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:2401:x1876405507917056:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 266us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.481959:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 74 00010000:00010000:1.0:1789480078.482177:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c94c2e7c/0xdaa289fda243d93b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bd4 expref: 12 pid: 8493 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.482236:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527921152:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480078.482261:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.482271:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.482279:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.482286:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.482293:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.482320:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1789480078.482521:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3646:x1876405527920768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5558us (7007us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789480078.482530:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789480078.482550:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480078.482559:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2399:x1876405507916928:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1789480078.482865:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a698892e300/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789480078.482873:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527920768:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1789480078.483636:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789480078.483818:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480078.483829:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483844:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480078.483848:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483861:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483885:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483912:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef64cd0f/0xdaa289fda243db8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483936:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480078.483940:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483948:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480078.483952:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483959:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483971:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483978:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cfc7da8/0xdaa289fda243db87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.483994:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480078.483997:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480078.484000:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480078.484037:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3648:x1876405527921024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2335us (6548us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789480078.484050:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789480078.484086:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789480078.485827:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6987e91c00/2, rc 0, transno 4294967305 00000100:00100000:0.0:1789480078.485842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527921024:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1789480078.490534:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789480078.490558:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1789480078.491016:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507916928:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 8448us (9596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.491030:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1789480078.498367:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.498590:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917312 00000100:00100000:1.0:1789480078.498604:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917312 00000100:00100000:1.0:1789480078.498726:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:1.0:1789480078.498739:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11416:x1876405507917312:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789480078.498813:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480078.498849:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243db72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c6e expref: 16 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.498873:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480078.498879:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480078.498918:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.498934:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.498969:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480078.499130:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f9f8afe reply state 00000000d4299909 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.499158:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.499165:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480078.499168:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789480078.499171:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480078.499358:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+17:11416:x1876405507917312:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 620us (1006us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789480078.499366:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:0.0:1789480078.504340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.504466:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917440 00000100:00100000:3.0:1789480078.504479:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917440 00000100:00100000:3.0:1789480078.504591:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:3.0:1789480078.504604:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507917440:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789480078.504845:0:8493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789480078.504849:0:8493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789480078 -> 1789480077 00002000:00010000:3.0:1789480078.504852:0:8493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789480077 00002000:00010000:3.0:1789480078.504855:0:8493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789480078 -> 1789480077 00002000:00010000:3.0:1789480078.504858:0:8493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789480078.504986:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507917440:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 383us (659us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789480078.504996:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1789480078.509136:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.510456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917696 00000100:00100000:2.0:1789480078.510500:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917696 00000100:00100000:2.0:1789480078.510637:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:2.0:1789480078.510649:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+17:11416:x1876405507917696:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.510741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.510763:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.510774:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.510819:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.510835:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 17 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.510851:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527921280:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480078.510956:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480078.516502:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527921280:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480078.516541:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.520104:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.520627:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917824 00000100:00100000:2.0:1789480078.520640:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917824 00010000:00010000:2.0:1789480078.520689:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 18 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.520745:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 75 00000100:00100000:2.0:1789480078.520755:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:2402:x1876405507917824:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480078.520781:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480078.520805:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 18 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520819:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 18 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520847:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243db56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c60 expref: 18 pid: 6521 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520868:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:2.0:1789480078.520874:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520886:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520894:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.520925:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480078.520999:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+17:2402:x1876405507917824:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 245us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.521007:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 75 00010000:00010000:0.0:1789480078.521405:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521464:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521483:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521490:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521496:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.521501:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521509:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521521:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:0.0:1789480078.521524:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789480078.521528:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.521534:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243db9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.521606:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11416:x1876405507917696:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 10959us (12483us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789480078.521615:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1789480078.533472:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.533587:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507917952 00000100:00100000:3.0:1789480078.533600:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507917952 00000100:00100000:3.0:1789480078.533681:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1789480078.533693:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507917952:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789480078.533750:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.533774:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.533783:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480078.533788:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480078.533794:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.533837:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.533878:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 7 pid: 8435 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.533896:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527921408:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480078.534009:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480078.538029:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.538240:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918080 00000100:00100000:0.0:1789480078.538252:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918080 00010000:00010000:0.0:1789480078.538305:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 8 pid: 8435 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.538375:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:0.0:1789480078.538385:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507918080:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480078.538405:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480078.538432:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 8 pid: 8435 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.538448:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 8 pid: 8435 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.538481:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480078.538486:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480078.538493:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.538504:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.538526:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480078.538604:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507918080:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 219us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.538611:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00010000:00010000:3.0:1789480078.539711:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca7f6c97/0xdaa289fda243db80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c7c expref: 7 pid: 8435 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.539734:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527921408:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480078.539760:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539786:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539794:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539827:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539836:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539866:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539874:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480078.539879:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539889:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539908:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.539916:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000661c1542/0xdaa289fda243dba3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.540011:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507917952:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 6319us (6553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.540020:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1789480078.543861:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480078.543999:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918336 00000100:00100000:3.0:1789480078.544011:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918336 00000100:00100000:3.0:1789480078.544091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:3.0:1789480078.544102:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+16:11416:x1876405507918336:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789480078.544815:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.544841:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 16 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.544877:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.544926:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 16 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.544943:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 16 pid: 8915 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.544974:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527921536:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480078.545369:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480078.550298:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.550406:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527921536:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480078.550444:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.550656:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918464 00000100:00100000:3.0:1789480078.550686:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918464 00010000:00010000:3.0:1789480078.550735:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 17 pid: 8915 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.550840:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:3.0:1789480078.550853:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+17:2401:x1876405507918464:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480078.550876:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480078.550885:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 17 pid: 8915 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550901:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 17 pid: 8915 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550929:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243da99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c28 expref: 17 pid: 8915 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550948:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480078.550955:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 16 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550978:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550987:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.550995:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480078.551037:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480078.551109:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+16:2401:x1876405507918464:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 258us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480078.551117:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00010000:00010000:2.0:1789480078.551368:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551621:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551636:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 16 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551645:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551689:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 16 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.551704:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 16 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.551720:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527921664:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480078.552304:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480078.555990:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.556378:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527921664:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480078.556413:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.556629:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918592 00000100:00100000:1.0:1789480078.556639:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918592 00010000:00010000:1.0:1789480078.556689:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 17 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.556737:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:1.0:1789480078.556748:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+17:2402:x1876405507918592:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480078.556767:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480078.556775:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 17 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556789:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 17 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556841:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243db64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c67 expref: 17 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556859:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480078.556865:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556876:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556885:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.556919:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480078.557008:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+16:2402:x1876405507918592:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 261us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.557016:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00010000:00010000:2.0:1789480078.557276:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.557285:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480078.557437:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789480078.557813:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789480078.557862:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789480078.557958:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1876405527921792:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789480078.558019:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480078.558990:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480078.559278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527921792 00000100:00100000:0.0:1789480078.559289:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527921792 00000100:00100000:0.0:1789480078.559370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789480078.559380:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876405527921792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789480078.559513:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876405527921792:12345-0@lo:1000:mdt00_001.0 Request processed in 134us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.559521:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789480078.559723:0:6521:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789480078.559730:0:6521:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:2.0:1789480078.559757:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a698892ea00, transno 4294967310 00000004:00080000:2.0:1789480078.559794:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a698892e300, transno 4294967311 00000100:00100000:2.0:1789480078.559803:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1876405527921792:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789480078.559999:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789480078.560462:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1876405527921920:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789480078.560521:0:6521:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480078.560559:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480078.560929:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527921920 00000100:00100000:0.0:1789480078.560939:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527921920 00000100:00100000:0.0:1789480078.561012:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789480078.561024:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876405527921920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789480078.561252:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1876405527921920:12345-0@lo:1000:mdt00_001.0 Request processed in 229us (729us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789480078.561260:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789480078.561701:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6521:1876405527921920:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789480078.561775:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561788:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561798:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561806:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047bc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.561811:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561820:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561839:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:2.0:1789480078.561843:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480078.561849:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561855:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dbb1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561909:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561917:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561924:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561929:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.561933:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561938:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561947:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.561950:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480078.561957:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561985:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.561996:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.562036:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.562262:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527922048:192.168.206.44@tcp:105: 00000100:00100000:2.0:1789480078.562354:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480078.567495:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527922048:192.168.206.44@tcp:105: 00010000:00010000:2.0:1789480078.567540:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567553:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243daf4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567609:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567626:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567638:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567651:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567657:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567663:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567669:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.567673:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567701:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567715:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.567718:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480078.567722:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567727:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dbb8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567737:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567742:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567747:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567751:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480078.567755:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567759:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567782:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480078.567784:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480078.567787:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480078.567803:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dbaa lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480078.568031:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11416:x1876405507918336:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 23929us (24180us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789480078.568043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000020:00080000:2.0:1789480078.568051:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789480078.568333:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480078.568339:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480078.568908:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789480078.568920:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480078.572457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.572544:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918720 00000100:00100000:2.0:1789480078.572559:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918720 00000100:00100000:2.0:1789480078.572644:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:2.0:1789480078.572656:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11415:x1876405507918720:12345-192.168.206.44@tcp:49:lfs.0 00000100:00100000:2.0:1789480078.572834:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11415:x1876405507918720:12345-192.168.206.44@tcp:49:lfs.0 Request processed in 180us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480078.572842:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1789480078.574742:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.574919:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507918976 00000100:00100000:1.0:1789480078.574932:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507918976 00000100:00100000:1.0:1789480078.575014:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:1.0:1789480078.575026:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:11416:x1876405507918976:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789480078.575423:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789480078.575466:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789480078.575508:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575528:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575565:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575574:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575581:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575587:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.575605:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789480078.575722:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11416:x1876405507918976:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 698us (991us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789480078.575731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000020:00080000:1.0:1789480078.575736:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789480078.576235:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480078.576245:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.576253:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480078.576258:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.576267:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.576282:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:0.0:1789480078.576294:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789480078.576301:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.576308:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dbbf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.576324:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480078.576326:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480078.576328:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480078.579649:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.579885:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507919232 00000100:00100000:1.0:1789480078.579897:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507919232 00000100:00100000:0.0:1789480078.580049:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:0.0:1789480078.580064:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11415:x1876405507919232:12345-192.168.206.44@tcp:58:lfs.0 00000040:00080000:0.0:1789480078.580314:0:8915:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789480078.580392:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11415:x1876405507919232:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 332us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.580400:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:3.0:1789480078.613442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480078.613556:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507919360 00000100:00100000:0.0:1789480078.613568:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507919360 00000100:00100000:0.0:1789480078.613645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:0.0:1789480078.613656:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+21:11418:x1876405507919360:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480078.613686:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480078.613711:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dbc6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c83 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613798:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613816:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613850:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613865:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613873:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613879:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613958:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613979:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 22 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.613988:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.614027:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 22 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.614048:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 22 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480078.614063:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527922176:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480078.614176:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480078.617100:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480078.617330:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507919616 00000100:00100000:2.0:1789480078.617343:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507919616 00000100:00100000:2.0:1789480078.617419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:2.0:1789480078.617432:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:6179:x1876405507919616:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789480078.617717:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+24:6179:x1876405507919616:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 288us (630us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789480078.617725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1789480078.618617:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527922176:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480078.618651:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480078.621069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480078.621181:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507919744 00000100:00100000:1.0:1789480078.621251:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507919744 00010000:00010000:1.0:1789480078.621307:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 24 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480078.621356:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:1.0:1789480078.621367:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+24:2401:x1876405507919744:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480078.621384:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480078.621394:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 24 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621431:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 24 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621460:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dae6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c44 expref: 24 pid: 12158 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621480:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:1.0:1789480078.621486:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621498:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621507:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480078.621535:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480078.621626:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+23:2401:x1876405507919744:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 261us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480078.621635:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00010000:00010000:0.0:1789480078.621888:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.621898:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480078.621979:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789480078.621984:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480078.622015:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622032:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622057:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622066:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622074:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622083:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.622088:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622098:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622123:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:0.0:1789480078.622127:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480078.622133:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622140:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dbcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622157:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622164:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622171:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622177:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480078.622180:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622186:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622259:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a6abb541a00) 00010000:00010000:0.0:1789480078.622262:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480078.622265:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622271:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dbd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622328:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dbc6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c83 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622343:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c83 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480078.622352:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480078.622354:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480078.622357:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db800, rc 0) 00000100:00100000:0.0:1789480078.622396:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11418:x1876405507919360:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 8742us (8967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480078.622405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00010000:00010000:2.0:1789480078.660405:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480079.045659:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527922688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045725:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.045769:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527923200:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045797:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.045823:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789480079.045830:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527922304:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045857:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.045876:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527922816:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045912:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.045928:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527923328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045947:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.045974:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527922432:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.045995:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.046010:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527922944:0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046583:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527922560:0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046618:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480079.046640:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527923072:0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046669:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922816 00000100:00100000:1.0:1789480079.046677:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922816 00000100:00100000:1.0:1789480079.046716:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922560 00000100:00100000:1.0:1789480079.046719:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922560 00000100:00100000:1.0:1789480079.046748:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789480079.046755:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527922816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046812:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527922816:12345-0@lo:400:kworker.0 Request processed in 57us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480079.046818:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789480079.046834:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789480079.046839:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527922560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046865:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527922560:12345-0@lo:400:kworker.0 Request processed in 26us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480079.046870:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789480079.046885:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922688 00000100:00100000:1.0:1789480079.046888:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922688 00000100:00100000:1.0:1789480079.046906:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923328 00000100:00100000:1.0:1789480079.046908:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923328 00000100:00100000:1.0:1789480079.046928:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922432 00000100:00100000:1.0:1789480079.046930:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922432 00000100:00100000:1.0:1789480079.046940:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789480079.046945:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527922688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.046969:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527922688:12345-0@lo:400:kworker.0 Request processed in 24us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480079.046974:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789480079.046983:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789480079.046987:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527923328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.047008:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527923328:12345-0@lo:400:kworker.0 Request processed in 21us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480079.047014:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789480079.047023:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789480079.047804:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527922816:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.047818:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527923328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.047828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527922688:0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.048227:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527922432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.048278:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527922432:12345-0@lo:400:kworker.0 Request processed in 56us (2282us total) trans 0 rc 0/0 00000100:00080000:0.0:1789480079.049620:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480079.050006:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922304 00000100:00100000:0.0:1789480079.050013:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922304 00000100:00100000:3.0:1789480079.050014:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.050048:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1789480079.050057:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527922304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.051317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527923456:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.051328:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527922304:12345-0@lo:400:kworker.0 Request processed in 1258us (5455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.051337:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789480079.051359:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.051383:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527923712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480079.051420:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.051452:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527922304:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.051496:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923712 00000100:00100000:0.0:1789480079.051501:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923712 00000100:00100000:0.0:1789480079.051529:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789480079.051536:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527923712:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480079.051566:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527922432:0@lo:400:kworker.0 00000004:00000024:0.0:1789480079.051566:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480079.051603:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527923712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.051609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789480079.051640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527923712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480079.051671:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527922944 00000100:00100000:0.0:1789480079.051675:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527922944 00000100:00100000:0.0:1789480079.051703:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923456 00000100:00100000:0.0:1789480079.051705:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923456 00000100:00100000:0.0:1789480079.051718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789480079.051724:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527922944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.051755:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698769b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527922944:12345-0@lo:400:kworker.0 Request processed in 32us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.051760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789480079.051772:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789480079.051778:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527923456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.051803:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527923456:12345-0@lo:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.051809:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789480079.051875:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527922944:0@lo:400:kworker.0 00010000:00080000:3.0:1789480079.051887:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698892ea00 x1876405527923456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480079.051894:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923200 00000100:00100000:0.0:1789480079.051904:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923200 00000100:00100000:0.0:1789480079.051933:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789480079.051939:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527923200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.051974:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987fad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527923200:12345-0@lo:400:kworker.0 Request processed in 35us (6176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.051980:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789480079.051995:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480079.051999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480079.052001:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480079.052017:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527923200:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.052278:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527923456:0@lo:400:kworker.0 00000100:00100000:1.0:1789480079.052728:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1789480079.052891:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480079.053226:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527923584:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.053231:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923072 00000100:00100000:0.0:1789480079.053236:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923072 00000100:00100000:3.0:1789480079.053264:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.053268:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789480079.053274:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527923072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.053295:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527922560:0@lo:400:kworker.0 00000100:00100000:0.0:1789480079.053307:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527923072:12345-0@lo:400:kworker.0 Request processed in 34us (991us total) trans 0 rc 0/0 00010000:00080000:3.0:1789480079.053311:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698892e680 x1876405527923072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480079.053313:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789480079.053321:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527923072:0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.053337:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923584 00000100:00100000:3.0:1789480079.053340:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923584 00000100:00080000:0.0:1789480079.053340:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480079.053366:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480079.053371:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789480079.053378:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527923584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480079.053827:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527923584:12345-0@lo:400:kworker.0 Request processed in 449us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480079.053834:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480079.053892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527923584:0@lo:400:kworker.0 00000040:00080000:2.0:1789480079.429503:0:14272:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480079.429511:0:14272:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480079.429551:0:14272:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789480079.429558:0:14272:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480079.556338:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480079.556362:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527923840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480079.556426:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480079.556486:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923840 00000100:00100000:0.0:1789480079.556493:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923840 00000100:00100000:0.0:1789480079.556535:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789480079.556545:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527923840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789480079.556574:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1789480079.556620:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527923840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.556627:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789480079.556674:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527923840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480079.557229:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527923968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480079.557264:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480079.557434:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527923968 00000100:00100000:2.0:1789480079.557439:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527923968 00000100:00100000:2.0:1789480079.557479:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789480079.557487:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527923968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480079.557501:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1789480079.557549:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527923968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480079.557556:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789480079.557623:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527923968:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789480079.630638:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480079.630647:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480079.630671:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789480079.630677:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480079.632291:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527924096:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480079.632383:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789480079.644723:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527924096:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480079.647556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480079.647622:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507919872 00000100:00100000:3.0:1789480079.647638:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507919872 00000100:00100000:3.0:1789480079.647743:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:3.0:1789480079.647753:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11430:x1876405507919872:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480079.647786:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480079.647946:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11430:x1876405507919872:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 193us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480079.647953:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00080000:0.0:1789480079.648381:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480079.660385:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480079.660520:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507920128 00000100:00100000:1.0:1789480079.660531:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507920128 00000100:00100000:1.0:1789480079.660648:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:1.0:1789480079.660659:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+22:11430:x1876405507920128:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480079.660687:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480079.660708:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dbe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c8a expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480079.660809:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480079.660824:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480079.660838:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480079.660974:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789480079.661092:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dbe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c8a expref: 25 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480079.661109:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c8a expref: 24 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480079.661135:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:1.0:1789480079.661138:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480079.661142:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd000, rc 0) 00000100:00100000:1.0:1789480079.661377:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+24:11430:x1876405507920128:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 719us (1000us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789480079.661385:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:1.0:1789480079.675651:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480079.675935:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507920256 00000100:00100000:0.0:1789480079.675944:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507920256 00000100:00100000:0.0:1789480079.676011:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1789480079.676022:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+24:2401:x1876405507920256:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480079.676037:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480079.676059:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dbe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c8a expref: 24 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.676077:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480079.676082:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480079.676144:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+23:2401:x1876405507920256:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 124us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480079.676166:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1789480079.676622:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480079.676743:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507920512 00000100:00100000:0.0:1789480079.676748:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507920512 00000100:00100000:0.0:1789480079.676793:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:0.0:1789480079.676801:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+23:11430:x1876405507920512:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789480079.676879:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.676895:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.676905:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678404:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678419:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678426:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678432:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480079.678437:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678445:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678459:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:0.0:1789480079.678474:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480079.678480:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480079.678485:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dbf7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480079.678622:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+24:11430:x1876405507920512:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 1818us (1997us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789480079.678632:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000040:00080000:1.0:1789480079.678701:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480079.678706:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480079.679241:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789480079.679250:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789480079.684353:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480079.693087:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480079.697660:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507920768 00000100:00100000:0.0:1789480079.697688:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507920768 00000100:00100000:0.0:1789480079.697757:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1789480079.697768:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+24:11430:x1876405507920768:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480079.699306:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+25:11430:x1876405507920768:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 1533us (6221us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789480079.699317:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000001:00080000:2.0:1789480080.071413:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1789480080.071431:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00010000:00010000:0.0:1789480080.716763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480081.445238:0:14324:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480081.445247:0:14324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480081.445277:0:14324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789480081.445283:0:14324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480081.604384:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480081.604407:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527924224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480081.604470:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480081.604567:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924224 00000100:00100000:2.0:1789480081.604574:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924224 00000100:00100000:2.0:1789480081.604633:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789480081.604642:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527924224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480081.604667:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480081.604717:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527924224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480081.604724:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789480081.604761:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789480081.604766:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1789480081.604782:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6987d2aa00, transno 4294967302 00000004:00080000:2.0:1789480081.604792:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789480081.604816:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6987e91c00, transno 4294967305 00000100:00100000:2.0:1789480081.604827:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527924224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789480081.605028:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480081.605665:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480081.605677:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480081.605718:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480081.605774:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924352 00000100:00100000:0.0:1789480081.605780:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924352 00000100:00100000:0.0:1789480081.605817:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789480081.605824:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480081.605838:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480081.605872:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480081.605886:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1789480081.605904:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480081.605927:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480081.725165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480081.725279:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921024 00000100:00100000:2.0:1789480081.725289:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921024 00000100:00100000:2.0:1789480081.725393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 145 00000100:00100000:2.0:1789480081.725404:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+25:11451:x1876405507921024:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480081.725426:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480081.725446:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dbfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480081.725548:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dc05 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480081.725573:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dc05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480081.725586:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dc05 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480081.725599:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789480081.725718:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dbfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c91 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480081.725747:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dc05 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c91 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480081.725755:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:2.0:1789480081.725757:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789480081.725779:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047bc00, rc 0) 00000100:00100000:2.0:1789480081.725986:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+27:11451:x1876405507921024:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 584us (829us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789480081.725994:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 145 00000100:00080000:0.0:1789480081.726360:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480081.733458:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480081.736570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480081.736644:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921152 00000100:00100000:1.0:1789480081.736653:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921152 00000100:00100000:1.0:1789480081.736720:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:1.0:1789480081.736730:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+27:11451:x1876405507921152:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1789480081.736790:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736806:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736818:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736851:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736877:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736884:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736890:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480081.736895:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736902:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736914:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:1.0:1789480081.736916:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480081.736922:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480081.736927:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243dc13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480081.737005:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+27:11451:x1876405507921152:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 276us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480081.737013:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:1.0:1789480081.878071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480081.882023:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921280 00000100:00100000:0.0:1789480081.882038:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921280 00000100:00100000:0.0:1789480081.882128:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1789480081.882140:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507921280:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1789480081.882157:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480081.882180:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243dc1a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c98 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789480081.882234:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1789480081.882277:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94c8d, atime: 0x6aa94c8d, ctime: 0x6aa94c8d, blocks: 0x8 00010000:00010000:0.0:1789480081.882298:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1789480081.882303:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480081.882312:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243dc1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c98 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480081.882331:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243dc1a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c98 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480081.882344:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da000, rc 0) 00000100:00100000:0.0:1789480081.882401:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507921280:12345-192.168.206.44@tcp:101:cat.0 Request processed in 264us (4339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480081.882423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1789480081.887607:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480081.888089:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921408 00000100:00100000:3.0:1789480081.888099:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921408 00002000:00100000:3.0:1789480081.888145:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a698892ed80 x1876405507921408/t0(0) o3->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:232/0 lens 488/0 e 0 to 0 dl 1789480092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480081.888155:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a698892ed80 with x1876405507921408 ext(0->4095) 00002000:00010000:3.0:1789480081.888160:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a698892ed80 00000100:00100000:3.0:1789480081.888288:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1789480081.888299:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2399:x1876405507921408:12345-192.168.206.44@tcp:3:cat.0 00000100:00100000:3.0:1789480081.888495:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2399:x1876405507921408:12345-192.168.206.44@tcp:3:cat.0 Request processed in 198us (895us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789480081.888503:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00002000:00100000:3.0:1789480081.888511:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a698892ed80 x1876405507921408/t0(0) o3->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:232/0 lens 488/4536 e 0 to 0 dl 1789480092 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480081.888530:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a698892ed80 with x1876405507921408 ext(0->4095) 00002000:00010000:3.0:1789480081.888534:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a698892ed80 00000100:00100000:0.0:1789480082.116553:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480082.116622:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480082.116733:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924480 00000100:00100000:2.0:1789480082.116741:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924480 00000100:00100000:2.0:1789480082.116800:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789480082.116808:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480082.116840:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789480082.116899:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.116906:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789480082.116943:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480082.265254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265302:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265391:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265407:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265442:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480082.265471:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921536 00000100:00100000:2.0:1789480082.265479:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921536 00000100:00100000:2.0:1789480082.265522:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 393 00000100:00100000:2.0:1789480082.265532:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507921536:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480082.265595:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507921536:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.265614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 393 00000100:00100000:2.0:1789480082.265643:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921664 00000100:00100000:2.0:1789480082.265647:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921664 00000100:00100000:2.0:1789480082.265667:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922176 00000100:00100000:2.0:1789480082.265669:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922176 00000100:00100000:2.0:1789480082.265686:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921792 00000100:00100000:2.0:1789480082.265703:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921792 00000100:00100000:2.0:1789480082.265715:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922304 00000100:00100000:2.0:1789480082.265717:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922304 00000100:00100000:2.0:1789480082.265729:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 330 00000100:00100000:2.0:1789480082.265735:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+27:2399:x1876405507921664:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480082.265764:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+27:2399:x1876405507921664:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.265770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 330 00000100:00100000:2.0:1789480082.265781:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00100000:2.0:1789480082.265786:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507922176:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480082.265804:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507922176:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 18us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.265809:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 331 00000100:00100000:2.0:1789480082.265818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 332 00000100:00100000:2.0:1789480082.265823:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507921792:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480082.265842:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507921792:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 19us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.265847:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 332 00000100:00100000:2.0:1789480082.265859:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 333 00000100:00100000:2.0:1789480082.265871:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507922304:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480082.265896:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507922304:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480082.265902:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 333 00000100:00100000:3.0:1789480082.266176:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507921920 00000100:00100000:3.0:1789480082.266181:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507921920 00000100:00100000:3.0:1789480082.266246:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922048 00000100:00100000:3.0:1789480082.266250:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922048 00000100:00100000:3.0:1789480082.266279:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:3.0:1789480082.266286:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507921920:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480082.266322:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507921920:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 36us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480082.266328:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:3.0:1789480082.266341:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:3.0:1789480082.266348:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2399:x1876405507922048:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480082.266373:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2399:x1876405507922048:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480082.266379:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00080000:0.0:1789480082.266466:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480082.266471:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480082.266473:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789480082.756405:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480083.780648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480084.164481:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480084.164514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527924608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480084.164609:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480084.164714:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924608 00000100:00100000:0.0:1789480084.164726:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924608 00000100:00100000:0.0:1789480084.164781:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789480084.164790:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527924608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480084.164836:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480084.171354:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527924608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6548us (6729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.171384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789480084.171500:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527924736:0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.171585:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.171761:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924736 00000100:00100000:3.0:1789480084.171777:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924736 00000100:00100000:3.0:1789480084.171849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789480084.171865:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.171951:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527924864:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.171970:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527924736:12345-0@lo:400:kworker.0 Request processed in 108us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480084.171978:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789480084.172012:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480084.172043:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527925376:0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.172070:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480084.172092:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527925888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172138:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924992:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172215:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.172248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527925504:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172272:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.172289:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527926016:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172308:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.172340:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925504 00000100:00100000:3.0:1789480084.172344:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925504 00000100:00100000:3.0:1789480084.172375:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926016 00000100:00100000:3.0:1789480084.172378:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926016 00000100:00100000:3.0:1789480084.172397:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789480084.172403:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527925504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172440:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527925504:12345-0@lo:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480084.172446:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789480084.172458:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789480084.172464:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527926016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.172492:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527926016:12345-0@lo:400:kworker.0 Request processed in 29us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480084.172498:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789480084.174117:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.174151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527925120:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.174250:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.174287:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527925632:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.174313:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.174332:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527926144:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.174373:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480084.174397:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789480084.174403:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527925248:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.174424:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480084.175322:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527924608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480084.175477:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527924736:0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.175519:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924992 00000100:00100000:0.0:1789480084.175529:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924992 00000100:00100000:0.0:1789480084.175597:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789480084.175606:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.175698:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527924992:12345-0@lo:400:kworker.0 Request processed in 92us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.175722:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1789480084.175748:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480084.175756:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480084.175770:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925632 00000100:00100000:0.0:1789480084.175775:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925632 00000100:00100000:0.0:1789480084.177140:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926144 00000100:00100000:0.0:1789480084.177153:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926144 00000100:00100000:0.0:1789480084.177207:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789480084.177219:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527925632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.177549:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527925632:12345-0@lo:400:kworker.0 Request processed in 331us (3233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.177558:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789480084.177577:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789480084.177584:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527926144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.177618:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527926144:12345-0@lo:400:kworker.0 Request processed in 35us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.177624:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1789480084.177647:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480084.177651:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480084.180399:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527924864 00000100:00100000:2.0:1789480084.180412:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527924864 00000100:00100000:2.0:1789480084.180470:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925376 00000100:00100000:2.0:1789480084.180474:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925376 00000100:00100000:2.0:1789480084.180513:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925888 00000100:00100000:2.0:1789480084.180516:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925888 00000100:00100000:2.0:1789480084.180530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925120 00000100:00100000:2.0:1789480084.180533:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925120 00000100:00100000:2.0:1789480084.180542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925248 00000100:00100000:2.0:1789480084.180544:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925248 00000100:00100000:2.0:1789480084.180561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789480084.180571:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527924864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.180661:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527924864:12345-0@lo:400:kworker.0 Request processed in 91us (8649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480084.180668:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1789480084.180684:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1789480084.180691:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527925376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480084.180852:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789480084.180889:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527925888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480084.180908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1789480084.180923:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527925120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480084.180982:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527925888:12345-0@lo:400:kworker.0 Request processed in 102us (6877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480084.180989:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789480084.181011:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789480084.181019:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527925248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480084.181049:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527925248:12345-0@lo:400:kworker.0 Request processed in 32us (6624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480084.181055:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789480084.181063:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527925120:12345-0@lo:400:kworker.0 Request processed in 143us (6811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480084.181071:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789480084.181249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527924992:0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.181278:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6985dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527925376:12345-0@lo:400:kworker.0 Request processed in 581us (9201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480084.181284:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527925504:0@lo:400:kworker.0 00000100:00100000:1.0:1789480084.181304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527926016:0@lo:400:kworker.0 00000001:00080000:0.0:1789480084.181328:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00080000:1.0:1789480084.181357:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789480084.181365:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480084.181389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527924864:0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.181406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00080000:1.0:1789480084.181409:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888d5c00 x1876405527925376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480084.181424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527925376:0@lo:400:kworker.0 00010000:00080000:1.0:1789480084.181440:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888d5180 x1876405527925888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480084.181448:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527925888:0@lo:400:kworker.0 00010000:00010000:1.0:1789480084.181493:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181518:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181525:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181531:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480084.181536:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181544:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181564:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a6aa31c0200) 00010000:00010000:1.0:1789480084.181568:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480084.181574:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480084.181581:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243db95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480084.181618:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6987dcf240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789480084.181624:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b8a100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a6987dcfc00 00000020:00080000:0.0:1789480084.181635:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b8a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6987669e00 00000020:00080000:0.0:1789480084.181661:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789480084.184097:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789480084.184213:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1789480084.187612:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527925248:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.187631:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527925760:0@lo:400:kworker.0 00000001:00080000:1.0:1789480084.187720:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:3.0:1789480084.187734:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1789480084.187737:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:3.0:1789480084.187778:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527925120:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.187791:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527925632:0@lo:400:kworker.0 00000100:00100000:3.0:1789480084.187802:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527926144:0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.190085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527925760 00000100:00100000:2.0:1789480084.190098:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527925760 00000100:00100000:2.0:1789480084.190307:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789480084.190320:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480084.190428:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527925760:12345-0@lo:400:kworker.0 Request processed in 111us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480084.190437:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789480084.190509:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527925760:0@lo:400:kworker.0 00000100:00080000:1.0:1789480084.191908:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480084.680168:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527926272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480084.680253:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480084.683091:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926272 00000100:00100000:2.0:1789480084.683104:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926272 00000100:00100000:2.0:1789480084.683155:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789480084.683164:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527926272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480084.683219:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789480084.683293:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527926272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480084.683301:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789480084.685228:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480084.685319:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527926272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480084.687152:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480084.687410:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480084.688793:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926400 00000100:00100000:2.0:1789480084.688805:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926400 00000100:00100000:2.0:1789480084.688859:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789480084.688869:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480084.688893:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789480084.689141:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 272us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480084.689156:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789480084.689469:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789480084.689476:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1789480084.689504:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789480084.804457:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480085.188813:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789480085.828431:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480085.830345:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480085.830353:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480085.830412:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789480085.830422:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480086.725135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480086.725265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480086.725418:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926528 00000100:00100000:1.0:1789480086.725430:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926528 00000100:00100000:1.0:1789480086.725513:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789480086.725525:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789480086.725562:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480086.725620:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480086.725627:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789480086.725650:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480086.725917:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480086.734591:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480086.734637:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527926656:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480086.734976:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480086.735092:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926656 00000100:00100000:0.0:1789480086.735103:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926656 00000100:00100000:0.0:1789480086.735208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480086.735220:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527926656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480086.735250:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1789480086.735313:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480086.737783:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527926656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2479us (2721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480086.737802:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789480086.739184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987e91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527926656:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789480086.853630:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480087.061398:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480087.061495:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922432 00000100:00100000:0.0:1789480087.061508:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922432 00000100:00100000:0.0:1789480087.061605:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00100000:0.0:1789480087.061623:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:11104:x1876405507922432:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789480087.061750:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:11104:x1876405507922432:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 129us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480087.061758:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 147 00000100:00080000:1.0:1789480087.061962:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480087.063140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480087.063238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922560 00000100:00100000:2.0:1789480087.063249:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922560 00000100:00100000:2.0:1789480087.063315:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:2.0:1789480087.063326:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:11104:x1876405507922560:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789480087.063419:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:11104:x1876405507922560:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.063426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00080000:1.0:1789480087.064129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480087.067337:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480087.067755:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922816 00000100:00100000:2.0:1789480087.067769:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922816 00000100:00100000:2.0:1789480087.067921:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:2.0:1789480087.067934:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+13:11104:x1876405507922816:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789480087.069834:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+14:11104:x1876405507922816:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 1887us (2496us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789480087.069850:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1789480087.236967:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480087.236998:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527926784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480087.237089:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480087.237343:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926784 00000100:00100000:1.0:1789480087.237354:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926784 00000100:00100000:1.0:1789480087.237426:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789480087.237448:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527926784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480087.237503:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789480087.237573:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527926784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.237581:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789480087.237967:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527926784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480087.382253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480087.382296:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480087.382359:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480087.382401:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480087.382451:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923456 00000100:00100000:1.0:1789480087.382459:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923456 00000100:00100000:1.0:1789480087.382512:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00100000:1.0:1789480087.382520:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507923456:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480087.382580:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507923456:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 61us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480087.382596:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00080000:1.0:1789480087.382616:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480087.382693:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507922944 00000100:00100000:2.0:1789480087.382697:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507922944 00000100:00100000:2.0:1789480087.382731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 395 00000100:00100000:2.0:1789480087.382738:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507922944:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480087.382762:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2399:x1876405507922944:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.382768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 395 00000100:00100000:0.0:1789480087.385761:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480087.387893:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923200 00000100:00100000:3.0:1789480087.387913:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923200 00000100:00100000:3.0:1789480087.388363:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923712 00000100:00100000:3.0:1789480087.388368:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923712 00000100:00100000:2.0:1789480087.388634:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00100000:2.0:1789480087.388646:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507923200:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480087.388726:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507923200:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 83us (6429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.388734:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 340 00000100:00100000:2.0:1789480087.388765:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 341 00000100:00100000:2.0:1789480087.388772:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507923712:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480087.389172:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507923712:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 38us (6407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480087.389181:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 341 00000100:00080000:2.0:1789480087.389243:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480087.390251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480087.390289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480087.390341:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923328 00000100:00100000:3.0:1789480087.390349:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923328 00000100:00100000:3.0:1789480087.390398:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:3.0:1789480087.390407:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507923328:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480087.390454:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507923328:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 49us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480087.390461:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00080000:3.0:1789480087.390746:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480087.391010:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923072 00000100:00100000:3.0:1789480087.391015:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923072 00000100:00100000:3.0:1789480087.393722:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923584 00000100:00100000:3.0:1789480087.393735:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923584 00000100:00100000:0.0:1789480087.393888:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 342 00000100:00100000:0.0:1789480087.394025:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+14:2399:x1876405507923072:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480087.394183:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+14:2399:x1876405507923072:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 285us (8429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480087.394208:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 342 00000100:00100000:0.0:1789480087.394227:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 343 00000100:00100000:0.0:1789480087.394951:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507923584:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480087.394990:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2399:x1876405507923584:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 46us (4700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480087.394997:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 343 00000100:00080000:2.0:1789480087.395446:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480087.876335:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480088.901011:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480088.963440:0:14521:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:48:07 (1789480087) 00000100:00100000:1.0:1789480089.284546:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480089.284568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480089.284638:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480089.284810:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527926912 00000100:00100000:0.0:1789480089.284817:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527926912 00000100:00100000:0.0:1789480089.284873:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789480089.284882:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480089.284922:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480089.284979:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987e91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527926912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.284986:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789480089.285089:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527926912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480089.285664:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527927168:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285706:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.285739:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527927680:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285760:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.285775:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527928192:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285794:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.285814:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789480089.285819:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527927296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285861:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.285881:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527927808:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285905:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.285941:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527928320:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.285971:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.286270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927168 00000100:00100000:3.0:1789480089.286276:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927168 00000100:00100000:3.0:1789480089.286314:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927680 00000100:00100000:3.0:1789480089.286317:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927680 00000100:00100000:3.0:1789480089.286341:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928192 00000100:00100000:3.0:1789480089.286344:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928192 00000100:00100000:3.0:1789480089.286359:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789480089.286366:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527927168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286413:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527927168:12345-0@lo:400:kworker.0 Request processed in 47us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286419:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789480089.286433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789480089.286438:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527927680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286463:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527927680:12345-0@lo:400:kworker.0 Request processed in 25us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789480089.286479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789480089.286485:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527928192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286509:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527928192:12345-0@lo:400:kworker.0 Request processed in 25us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286514:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789480089.286533:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927296 00000100:00100000:3.0:1789480089.286536:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927296 00000100:00100000:3.0:1789480089.286559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789480089.286565:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527927296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286592:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527927296:12345-0@lo:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286605:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789480089.286623:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927808 00000100:00100000:3.0:1789480089.286626:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927808 00000100:00100000:3.0:1789480089.286649:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928320 00000100:00100000:3.0:1789480089.286652:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928320 00000100:00100000:3.0:1789480089.286669:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789480089.286675:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527927808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286705:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527927808:12345-0@lo:400:kworker.0 Request processed in 30us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286710:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789480089.286721:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789480089.286727:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527928320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286754:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527928320:12345-0@lo:400:kworker.0 Request processed in 27us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.286759:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789480089.286808:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527927296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286820:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527927808:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286828:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527928320:0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.286838:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527927168:0@lo:400:kworker.0 00010000:00080000:3.0:1789480089.286848:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2df80 x1876405527927680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480089.286857:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527927680:0@lo:400:kworker.0 00010000:00080000:3.0:1789480089.286866:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2f480 x1876405527928192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480089.286881:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527928192:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.286995:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527927040:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287041:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527927552:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287095:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287113:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527928064:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287133:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287161:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789480089.287168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527927424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287209:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287225:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527927936:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287246:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287260:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527928448:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287290:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480089.287315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927552 00000100:00100000:1.0:1789480089.287320:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927552 00000100:00100000:1.0:1789480089.287342:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928064 00000100:00100000:1.0:1789480089.287345:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928064 00000100:00100000:1.0:1789480089.287357:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927424 00000100:00100000:1.0:1789480089.287359:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927424 00000100:00100000:1.0:1789480089.287370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789480089.287376:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527927552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287421:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527927552:12345-0@lo:400:kworker.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.287429:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789480089.287442:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789480089.287448:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527928064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287473:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527928064:12345-0@lo:400:kworker.0 Request processed in 26us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.287479:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1789480089.287490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789480089.287496:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527927424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287521:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527927424:12345-0@lo:400:kworker.0 Request processed in 26us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480089.287527:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789480089.287555:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527927424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287564:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527927552:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.287572:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527928064:0@lo:400:kworker.0 00000100:00080000:2.0:1789480089.287660:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480089.287665:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480089.287667:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480089.287669:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789480089.288030:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927040 00000100:00100000:3.0:1789480089.288035:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927040 00000100:00100000:3.0:1789480089.288118:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789480089.288126:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480089.288184:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527927040:12345-0@lo:400:kworker.0 Request processed in 60us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.288221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1789480089.289285:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527927040:0@lo:400:kworker.0 00000100:00100000:0.0:1789480089.294177:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527927936 00000100:00100000:0.0:1789480089.294205:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527927936 00000100:00100000:0.0:1789480089.294294:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928448 00000100:00100000:0.0:1789480089.294299:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928448 00000100:00100000:0.0:1789480089.294321:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480089.294330:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527927936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480089.294423:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527927936:12345-0@lo:400:kworker.0 Request processed in 94us (7175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.294431:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480089.294445:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789480089.294452:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527928448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480089.294478:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527928448:12345-0@lo:400:kworker.0 Request processed in 27us (7188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480089.294484:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1789480089.294564:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480089.294568:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480089.294605:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527927936:0@lo:400:kworker.0 00000100:00100000:1.0:1789480089.294616:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527928448:0@lo:400:kworker.0 00000100:00100000:2.0:1789480089.797085:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480089.797126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527928576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480089.797242:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480089.797378:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928576 00000100:00100000:3.0:1789480089.797386:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928576 00000100:00100000:3.0:1789480089.797441:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789480089.797451:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527928576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480089.797478:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789480089.797524:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527928576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480089.797531:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789480089.798012:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480089.798023:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527928704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480089.798057:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480089.798461:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928704 00000100:00100000:2.0:1789480089.798468:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928704 00000100:00100000:2.0:1789480089.798505:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789480089.798513:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527928704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480089.798526:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789480089.798579:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527928704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480089.798585:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789480089.798625:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527928576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480089.799229:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527928704:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789480089.808714:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1789480089.808730:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789480089.808840:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789480089.808854:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789480089.924408:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480090.370544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480090.370821:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507923968 00000100:00100000:1.0:1789480090.370830:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507923968 00000100:00100000:1.0:1789480090.370910:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:1.0:1789480090.370920:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:12169:x1876405507923968:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480090.370948:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480090.370967:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243dc21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2c9f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.371032:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789480090.371248:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480090.371646:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.371664:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.371683:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.371691:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.371697:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372372:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243dc36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372384:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243dc36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372408:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243dc36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480090.372419:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789480090.372507:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372515:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372521:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372527:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480090.372531:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372539:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372550:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6a97c2e200) 00010000:00010000:1.0:1789480090.372553:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480090.372557:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372564:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243dc28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372576:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372582:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372593:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372599:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480090.372601:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372607:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372614:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a698745ef00) 00010000:00010000:1.0:1789480090.372616:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480090.372618:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.372624:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243dc2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.373783:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243dc21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c9f expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.373804:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243dc36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c9f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480090.373813:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:1.0:1789480090.373815:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480090.373818:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd200, rc 0) 00000100:00100000:1.0:1789480090.373898:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+15:12169:x1876405507923968:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2978us (3361us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789480090.373918:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:2.0:1789480090.401641:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480090.401696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480090.401858:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924096 00000100:00100000:3.0:1789480090.401871:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924096 00000100:00100000:3.0:1789480090.401952:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1789480090.401969:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+15:2400:x1876405507924096:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480090.402012:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480090.402042:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243dc36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c9f expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480090.402066:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:3.0:1789480090.402072:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480090.402154:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+14:2400:x1876405507924096:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 177us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480090.402162:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789480090.402987:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924224 00000100:00100000:0.0:1789480090.402998:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924224 00000100:00100000:0.0:1789480090.403052:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:0.0:1789480090.403062:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+14:12169:x1876405507924224:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789480090.403183:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+14:12169:x1876405507924224:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 123us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480090.403240:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:2.0:1789480090.409431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480090.409695:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924352 00000100:00100000:0.0:1789480090.409709:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924352 00000100:00100000:0.0:1789480090.409806:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:0.0:1789480090.409820:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:12169:x1876405507924352:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789480090.410424:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480090.410479:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:12169:x1876405507924352:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 660us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480090.410508:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 151 00000040:00080000:1.0:1789480090.948352:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480090.948362:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480090.948865:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789480090.948878:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789480090.949333:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480091.340277:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480091.847810:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527928832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480091.847828:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527928960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480091.851077:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480091.851215:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928960 00000100:00100000:2.0:1789480091.851242:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928960 00000100:00100000:2.0:1789480091.851314:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789480091.851325:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527928960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480091.851366:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480091.851757:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480091.853341:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527928832 00000100:00100000:0.0:1789480091.853357:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527928832 00000100:00100000:0.0:1789480091.853419:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789480091.853430:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527928832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480091.853464:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480091.853630:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527928960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2298us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480091.853697:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527928832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 267us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480091.853706:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789480091.853736:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1789480091.853737:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480091.853802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527928832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480091.853826:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb589180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527928960:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480091.974359:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480092.357301:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527929088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480092.357427:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480092.357636:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527929088 00000100:00100000:3.0:1789480092.357647:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527929088 00000100:00100000:3.0:1789480092.357715:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789480092.357725:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527929088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480092.357764:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789480092.357824:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527929088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.357832:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789480092.357934:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527929088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480092.444522:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.444599:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924480 00000100:00100000:2.0:1789480092.444614:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924480 00000100:00100000:2.0:1789480092.444699:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:2.0:1789480092.444710:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+14:12212:x1876405507924480:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.444733:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.444797:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dc44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ca6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.444879:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445008:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789480092.445012:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789480092.445098:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445120:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445129:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445146:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445232:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445255:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445262:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445268:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480092.445273:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445281:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445293:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480092.445296:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.445301:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445321:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445326:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445332:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445338:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480092.445346:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445352:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445361:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a6987bf1a00) 00010000:00010000:2.0:1789480092.445363:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.445366:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445372:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445406:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dc44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ca6 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445418:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480092.445420:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.445425:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dc44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ca6 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.445437:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a000, rc 0) 00000100:00100000:2.0:1789480092.450416:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+14:12212:x1876405507924480:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 5694us (5896us total) trans 0 rc 301/301 00000100:00100000:2.0:1789480092.450430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:0.0:1789480092.459567:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.459646:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924736 00000100:00100000:3.0:1789480092.459658:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924736 00000100:00100000:3.0:1789480092.459722:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:3.0:1789480092.459734:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+14:12212:x1876405507924736:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:3.0:1789480092.459796:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480092.459827:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243d5a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad1 expref: 14 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.459866:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480092.459877:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480092.459955:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.459970:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.459981:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.459995:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460002:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460009:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460770:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460783:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460791:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480092.460803:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a32ab3a reply state 00000000821053f6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460825:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460831:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480092.460834:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480092.460837:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789480092.460842:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789480092.460849:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460855:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460861:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460867:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480092.460872:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460879:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.460887:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480092.460889:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480092.462300:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.462313:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dc59 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480092.462355:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a32ab3a reply state 00000000821053f6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.462369:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.462378:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a6aa31c0a00) 00010000:00010000:3.0:1789480092.462380:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480092.462383:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789480092.462487:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+15:12212:x1876405507924736:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 2751us (2924us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789480092.462495:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:2.0:1789480092.500555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500597:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500623:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500649:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500701:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500726:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.500751:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925248 00000100:00100000:2.0:1789480092.500762:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925248 00000100:00100000:2.0:1789480092.500832:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925120 00000100:00100000:2.0:1789480092.500836:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925120 00000100:00100000:2.0:1789480092.500860:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:2.0:1789480092.500871:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507925248:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.500967:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2400:x1876405507925248:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 98us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.500975:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:2.0:1789480092.500993:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:2.0:1789480092.501000:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507925120:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.501026:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507925120:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.501043:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:2.0:1789480092.501062:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924992 00000100:00100000:2.0:1789480092.501066:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924992 00000100:00100000:2.0:1789480092.501093:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925504 00000100:00100000:2.0:1789480092.501096:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925504 00000100:00100000:2.0:1789480092.501111:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925376 00000100:00100000:2.0:1789480092.501113:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925376 00000100:00100000:2.0:1789480092.501126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 350 00000100:00100000:2.0:1789480092.501143:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507924992:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.501173:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507924992:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 41us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.501179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 350 00000100:00100000:2.0:1789480092.501222:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 351 00000100:00100000:2.0:1789480092.501229:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507925504:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.501254:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507925504:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.501260:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 351 00000100:00100000:2.0:1789480092.501271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 352 00000100:00100000:2.0:1789480092.501276:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507925376:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.501299:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507925376:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.501304:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 352 00000100:00100000:2.0:1789480092.501323:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507924864 00000100:00100000:2.0:1789480092.501326:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507924864 00000100:00100000:2.0:1789480092.501368:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 397 00000100:00100000:2.0:1789480092.501375:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507924864:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480092.501399:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507924864:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.501405:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 397 00000100:00080000:2.0:1789480092.501435:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480092.501439:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480092.501442:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480092.501444:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480092.569119:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.569247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925632 00000100:00100000:2.0:1789480092.569259:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925632 00000100:00100000:2.0:1789480092.569321:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:2.0:1789480092.569332:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+15:12220:x1876405507925632:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:2.0:1789480092.569360:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.569389:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cad expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569455:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569471:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569485:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.569528:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789480092.569532:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480092.569551:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569576:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cad expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569593:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cad expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.569602:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:2.0:1789480092.569605:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480092.569609:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789480092.569670:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+16:12220:x1876405507925632:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 340us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.569678:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 154 00000100:00100000:3.0:1789480092.625940:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480092.626027:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507925760 00000100:00100000:0.0:1789480092.626050:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507925760 00000100:00100000:0.0:1789480092.626114:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00100000:0.0:1789480092.626126:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+16:12226:x1876405507925760:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480092.626160:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480092.626186:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dc7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626286:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626301:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626328:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626340:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626348:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626355:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626437:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626445:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480092.626485:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789480092.626489:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480092.626508:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626521:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626528:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626547:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626554:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480092.626559:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626570:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626585:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:0.0:1789480092.626588:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480092.626594:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626601:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dc83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626616:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626623:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626629:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626634:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480092.626650:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626668:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626676:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a6aa31c0a00) 00010000:00010000:0.0:1789480092.626679:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480092.626682:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626689:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dc8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626715:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dc7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cb4 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626730:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cb4 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.626737:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480092.626740:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789480092.626742:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da600, rc 0) 00000100:00100000:0.0:1789480092.626803:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+17:12226:x1876405507925760:12345-192.168.206.44@tcp:101:bash.0 Request processed in 679us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.626811:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 155 00000100:00100000:3.0:1789480092.632102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.636082:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926016 00000100:00100000:2.0:1789480092.636112:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926016 00000100:00100000:2.0:1789480092.636227:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:2.0:1789480092.636240:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+17:12226:x1876405507926016:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480092.636263:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.636288:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cbb expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.636675:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.636703:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.636716:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.638868:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.638897:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.638912:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789480092.639303:0:8915:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789480092.639861:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.639876:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.639902:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.639943:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640475:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640483:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640489:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047aa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480092.640493:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640502:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640517:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480092.640521:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480092.640526:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640533:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047aa00/0xdaa289fda243dc9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480092.640547:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056d89e7d reply state 0000000031301ba2 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640558:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640573:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:2.0:1789480092.640576:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480092.640579:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789480092.640633:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243dc98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 20 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640649:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 19 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.640657:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:2.0:1789480092.640660:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480092.640662:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1400, rc 0) 00000100:00100000:2.0:1789480092.640742:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+20:12226:x1876405507926016:12345-192.168.206.44@tcp:101:bash.0 Request processed in 4505us (8654us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1789480092.640751:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 156 00000100:00100000:3.0:1789480092.658768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.658802:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926144 00000100:00100000:3.0:1789480092.658813:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926144 00000100:00100000:2.0:1789480092.658903:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1789480092.658917:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2399:x1876405507926144:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480092.658940:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.658976:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cc2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480092.659005:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480092.659026:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1789480092.659030:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.659040:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.659078:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.659093:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:2.0:1789480092.659166:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2399:x1876405507926144:12345-192.168.206.44@tcp:101:bash.0 Request processed in 253us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.659174:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:0.0:1789480092.667184:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.668113:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926272 00000100:00100000:2.0:1789480092.668124:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926272 00000100:00100000:2.0:1789480092.668217:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:2.0:1789480092.668231:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:12226:x1876405507926272:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480092.668253:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.668275:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cc9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.668323:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.668333:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.668338:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480092.668343:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.668401:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.668428:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.668443:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb589880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527929216:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480092.668548:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.671299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480092.671397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926400 00000100:00100000:0.0:1789480092.671408:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926400 00010000:00010000:0.0:1789480092.671453:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 8 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.671514:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb589880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527929216:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480092.671519:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:0.0:1789480092.671533:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507926400:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480092.671550:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480092.671554:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.671575:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480092.671648:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:12226:x1876405507926272:12345-192.168.206.44@tcp:101:bash.0 Request processed in 3419us (4472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.671655:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00010000:00010000:0.0:1789480092.672082:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.672098:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.672123:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d91ada/0xdaa289fda243dcbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc2 expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.672270:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480092.672276:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480092.672286:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.672298:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.672339:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.672353:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876405527929344:192.168.206.44@tcp:105: 00000100:00100000:0.0:1789480092.672468:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.677891:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.677926:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926656 00000100:00100000:3.0:1789480092.677937:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926656 00000100:00100000:3.0:1789480092.677995:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:3.0:1789480092.678007:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+20:12226:x1876405507926656:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1789480092.678342:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12226:x1876405507926656:12345-192.168.206.44@tcp:35:bash.0 Request processed in 336us (455us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789480092.678352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1789480092.680915:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6505:1876405527929344:192.168.206.44@tcp:105: 00010000:00010000:0.0:1789480092.680945:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480092.681010:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507926400:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 9480us (9720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480092.681032:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:3.0:1789480092.794720:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480092.795425:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507926912 00000100:00100000:1.0:1789480092.795436:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507926912 00000100:00100000:1.0:1789480092.795507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:1.0:1789480092.795518:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12236:x1876405507926912:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480092.795546:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480092.795570:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dcc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cd0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480092.795669:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789480092.795785:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dcc9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cd0 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.795801:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:1.0:1789480092.795804:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480092.795809:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dcc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cd0 expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.795831:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd000, rc 0) 00000100:00100000:1.0:1789480092.795907:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:12236:x1876405507926912:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 391us (1196us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1789480092.795914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 157 00000100:00100000:3.0:1789480092.807436:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.808081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507927168 00000100:00100000:2.0:1789480092.808095:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507927168 00000100:00100000:2.0:1789480092.808183:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:2.0:1789480092.808235:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:12236:x1876405507927168:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480092.808501:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:12236:x1876405507927168:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 307us (1073us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789480092.808509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:3.0:1789480092.928154:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.928423:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507927296 00000100:00100000:2.0:1789480092.928434:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507927296 00000100:00100000:2.0:1789480092.928498:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00100000:2.0:1789480092.928518:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+23:12242:x1876405507927296:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.928564:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.928589:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dcd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cd7 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928661:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928678:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928690:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.928731:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789480092.928734:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480092.928753:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928791:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dcd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cd7 expref: 25 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928810:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cd7 expref: 24 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.928818:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480092.928821:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480092.928824:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1a00, rc 0) 00000100:00100000:2.0:1789480092.929005:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+24:12242:x1876405507927296:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 384us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.929013:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 158 00000100:00100000:0.0:1789480092.936867:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.937227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507927552 00000100:00100000:2.0:1789480092.937238:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507927552 00000100:00100000:2.0:1789480092.937306:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:2.0:1789480092.937318:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+24:12242:x1876405507927552:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.937342:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.937366:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dce5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cde expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.937471:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dcec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.937486:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.937500:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.937511:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789480092.937618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dce5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cde expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.937638:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dcec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cde expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.937646:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:2.0:1789480092.937649:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480092.937652:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1000, rc 0) 00000100:00100000:2.0:1789480092.937723:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+26:12242:x1876405507927552:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 407us (865us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789480092.937747:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:0.0:1789480092.942642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480092.942690:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.942759:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507927808 00000100:00100000:2.0:1789480092.942782:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507927808 00000100:00100000:2.0:1789480092.942849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:2.0:1789480092.942860:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+26:12242:x1876405507927808:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480092.942903:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480092.942928:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243dcfa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ce5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.943034:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.943053:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.943067:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480092.943079:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789480092.943224:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243dcfa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ce5 expref: 29 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.943243:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ce5 expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.943253:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:2.0:1789480092.943256:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480092.943260:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:2.0:1789480092.943326:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+28:12242:x1876405507927808:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 469us (693us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789480092.943333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:3.0:1789480092.943874:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507927936 00000100:00100000:3.0:1789480092.943882:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507927936 00000100:00100000:3.0:1789480092.943947:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1789480092.943956:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+28:2400:x1876405507927936:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480092.943969:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480092.943986:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dcec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cde expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.943999:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:3.0:1789480092.944004:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480092.944038:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+27:2400:x1876405507927936:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 84us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.944045:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1789480092.952867:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.953255:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928064 00000100:00100000:3.0:1789480092.953266:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928064 00000100:00100000:3.0:1789480092.953326:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480092.953338:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507928064:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:3.0:1789480092.953389:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.953410:0:8493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.953420:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480092.953424:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.953442:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.953480:0:8493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.953495:0:8493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 6 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.953520:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8493:1876405527929472:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480092.953615:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.959404:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8493:1876405527929472:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480092.959436:0:8493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.961586:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480092.962038:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928192 00000100:00100000:2.0:1789480092.962049:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928192 00002000:00100000:2.0:1789480092.962102:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a69888d6d80 x1876405507928192/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:243/0 lens 504/0 e 0 to 0 dl 1789480103 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480092.962113:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a69888d6d80 with x1876405507928192 ext(0->12) 00010000:00010000:2.0:1789480092.962122:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 7 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.962154:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 7 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480092.962163:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a69888d6d80 00000100:00100000:2.0:1789480092.962235:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1789480092.962246:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507928192:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:2.0:1789480092.963797:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507928192:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 1544us (2210us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789480092.963811:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00002000:00100000:2.0:1789480092.963824:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a69888d6d80 x1876405507928192/t4294967306(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:243/0 lens 504/448 e 0 to 0 dl 1789480103 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480092.963836:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a69888d6d80 with x1876405507928192 ext(0->12) 00010000:00010000:2.0:1789480092.963847:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.963881:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480092.963889:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a69888d6d80 00000100:00100000:0.0:1789480092.971286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.971373:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928320 00000100:00100000:3.0:1789480092.971384:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928320 00010000:00010000:3.0:1789480092.971424:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.971470:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:3.0:1789480092.971480:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2399:x1876405507928320:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480092.971496:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789480092.971524:0:9525:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789480092.971527:0:9525:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789480092 00002000:00010000:3.0:1789480092.971530:0:9525:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789480092 00002000:00010000:3.0:1789480092.971545:0:9525:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789480092 00002000:00010000:3.0:1789480092.971547:0:9525:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789480092.971555:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.971570:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.971596:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b271e990/0xdaa289fda243dcc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cc9 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.971613:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.971617:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789480092.971623:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.971633:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.971674:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480092.971725:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2399:x1876405507928320:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 245us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.971733:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00010000:00010000:2.0:1789480092.971911:0:8493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971922:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971943:0:8493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971951:0:8493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971960:0:8493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971967:0:8493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480092.971972:0:8493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.971982:0:8493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.972008:0:8493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480092.972016:0:8493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661c1542/0xdaa289fda243dd0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480092.972066:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507928064:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 18730us (19208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480092.972074:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:1.0:1789480092.976069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480092.976167:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928576 00000100:00100000:0.0:1789480092.976178:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928576 00000100:00100000:0.0:1789480092.976259:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:0.0:1789480092.976271:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12242:x1876405507928576:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:0.0:1789480092.976341:0:14183:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ce5 expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480092.976539:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789480092.976576:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789480092.976881:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1789480092.976937:0:14183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.976954:0:14183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 31 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.976981:0:14183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.977020:0:14183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 31 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.977036:0:14183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 31 pid: 8915 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.977051:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527929600:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480092.977142:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480092.981339:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.981454:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928704 00000100:00100000:3.0:1789480092.981466:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928704 00010000:00010000:3.0:1789480092.981517:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 32 pid: 8915 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480092.981579:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 82 00000100:00100000:3.0:1789480092.981591:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+32:2402:x1876405507928704:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480092.981607:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480092.981615:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 32 pid: 8915 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.981628:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 32 pid: 8915 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.981651:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:3.0:1789480092.981657:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.981668:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.981676:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.981696:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480092.981762:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+32:2402:x1876405507928704:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 173us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.981770:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 82 00010000:00010000:0.0:1789480092.982774:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dcad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cbb expref: 31 pid: 8915 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480092.982796:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527929600:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480092.982822:0:14183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.982832:0:14183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480092.982838:0:14183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480092.982957:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1789480092.983068:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789480092.983177:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527929728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789480092.983295:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.983330:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.983397:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527929728 00000100:00100000:3.0:1789480092.983404:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527929728 00000100:00100000:3.0:1789480092.983455:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789480092.983466:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14183:x1876405527929728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789480092.983584:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:14183:x1876405527929728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.983592:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789480092.983813:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527929728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1789480092.983917:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789480092.983977:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527929856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789480092.984006:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480092.984030:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480092.984147:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527929856 00000100:00100000:3.0:1789480092.984152:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527929856 00000100:00100000:3.0:1789480092.984186:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789480092.984227:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14183:x1876405527929856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789480092.984335:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14183:x1876405527929856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 109us (328us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789480092.984342:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789480092.984428:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527929856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789480092.984468:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789480092.984513:0:14183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984522:0:14183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984531:0:14183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984537:0:14183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480092.984542:0:14183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984551:0:14183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984568:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:1.0:1789480092.984571:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789480092.984577:0:14183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480092.984598:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243dd16 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480092.984690:0:14183:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789480092.984751:0:14183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789480092.984761:0:14183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 461908570589ns, next at 462908568611ns, rc = 0 00000001:00080000:1.0:1789480092.984767:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789480092.984789:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1600) 00010000:00010000:1.0:1789480092.984792:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480092.984799:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dd01 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ce5 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480092.984897:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+34:12242:x1876405507928576:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 8628us (8837us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789480092.984906:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000020:00080000:1.0:1789480092.984910:0:14183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789480092.988946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.989440:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507928832 00000100:00100000:3.0:1789480092.989453:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507928832 00000100:00100000:3.0:1789480092.989621:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:3.0:1789480092.989633:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+34:12242:x1876405507928832:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480092.989661:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480092.989689:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243dd1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cec expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.989751:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243dd1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cec expref: 35 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.989784:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243dd1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cec expref: 35 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480092.989804:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480092.989808:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480092.989825:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c7e00, rc 0) 00000100:00100000:3.0:1789480092.990000:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+35:12242:x1876405507928832:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 368us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480092.990008:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:0.0:1789480092.993619:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480092.993725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507929088 00000100:00100000:3.0:1789480092.993736:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507929088 00000100:00100000:3.0:1789480092.994017:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:3.0:1789480092.994029:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+35:12242:x1876405507929088:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480092.994307:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+36:12242:x1876405507929088:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 279us (694us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789480092.994315:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00010000:00010000:0.0:1789480093.002308:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480093.099116:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.099265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507929344 00000100:00100000:3.0:1789480093.099276:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507929344 00000100:00100000:3.0:1789480093.099341:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:3.0:1789480093.099352:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+36:12252:x1876405507929344:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480093.099381:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.099404:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dd24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cf3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480093.099499:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789480093.099612:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dd24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cf3 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.099628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:3.0:1789480093.099631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480093.099637:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dd24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cf3 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.099670:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6600, rc 0) 00000100:00100000:3.0:1789480093.099731:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12252:x1876405507929344:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 381us (625us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789480093.099738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:1.0:1789480093.104983:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480093.109592:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507929472 00000100:00100000:0.0:1789480093.109609:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507929472 00000100:00100000:0.0:1789480093.109756:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:0.0:1789480093.109783:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12252:x1876405507929472:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:0.0:1789480093.109896:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.109918:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.109934:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.109946:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.109954:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.109960:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110068:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110078:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110085:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480093.110150:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110163:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110170:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110178:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110183:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480093.110222:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110231:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110245:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480093.110248:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.110254:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110267:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110282:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110287:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110293:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110298:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480093.110302:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110308:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110316:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:0.0:1789480093.110319:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.110322:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110328:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243dd39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110338:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110344:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110356:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110360:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480093.110363:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110369:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110377:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480093.110379:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480093.110382:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.110388:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243dd40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480093.110473:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12252:x1876405507929472:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 693us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480093.110482:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:1.0:1789480093.113451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.113532:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507929728 00000100:00100000:3.0:1789480093.113543:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507929728 00000100:00100000:3.0:1789480093.113601:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1789480093.113612:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12252:x1876405507929728:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480093.113832:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+38:12252:x1876405507929728:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 221us (389us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789480093.113840:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:1.0:1789480093.161948:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.162039:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507929984 00000100:00100000:3.0:1789480093.162051:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507929984 00000100:00100000:3.0:1789480093.162113:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:3.0:1789480093.162125:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+38:12255:x1876405507929984:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480093.162164:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.162223:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dd47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2cfa expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162300:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162318:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162331:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162358:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162367:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162373:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162478:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162486:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162492:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480093.162501:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789480093.162593:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162601:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162608:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162614:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480093.162618:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162636:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162650:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480093.162652:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480093.162658:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162665:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243dd4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162678:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162683:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162689:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162694:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480093.162697:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162703:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162710:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:3.0:1789480093.162713:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480093.162716:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162732:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243dd55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162772:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243dd47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 41 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162786:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 40 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.162793:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.162795:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480093.162797:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030400, rc 0) 00000100:00100000:3.0:1789480093.162852:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12255:x1876405507929984:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 730us (914us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789480093.162860:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:1.0:1789480093.170574:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480093.170710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507930112 00000100:00100000:2.0:1789480093.170720:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507930112 00000100:00100000:2.0:1789480093.170784:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:2.0:1789480093.170796:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12255:x1876405507930112:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1789480093.170869:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170900:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170913:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170948:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170956:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170980:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170986:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480093.170990:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.170998:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.171024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480093.171028:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480093.171033:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.171040:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dd6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.171366:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12255:x1876405507930112:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 570us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.171375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 165 00000100:00100000:0.0:1789480093.188266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.188383:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507930368 00000100:00100000:3.0:1789480093.188395:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507930368 00000100:00100000:3.0:1789480093.188448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:3.0:1789480093.188458:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12255:x1876405507930368:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480093.188726:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+41:12255:x1876405507930368:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 269us (469us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789480093.188735:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1789480093.622041:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480093.622147:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507930624 00000100:00100000:0.0:1789480093.622159:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507930624 00000100:00100000:0.0:1789480093.622249:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:0.0:1789480093.622260:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+41:12286:x1876405507930624:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1789480093.622289:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480093.622316:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d01 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.622444:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dd78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.622461:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dd78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.622474:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dd78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480093.622485:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789480093.622598:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dd71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d01 expref: 44 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.622617:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dd78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d01 expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480093.622626:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480093.622629:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480093.622634:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db000, rc 0) 00000100:00100000:0.0:1789480093.622711:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12286:x1876405507930624:12345-192.168.206.44@tcp:101:cat.0 Request processed in 452us (680us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789480093.622719:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:0.0:1789480093.629665:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480093.629761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507930880 00000100:00100000:1.0:1789480093.629774:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507930880 00000100:00100000:1.0:1789480093.629837:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1789480093.629848:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12286:x1876405507930880:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:1.0:1789480093.630267:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+44:12286:x1876405507930880:12345-192.168.206.44@tcp:35:cat.0 Request processed in 419us (610us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789480093.630275:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1789480093.634426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.634524:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931008 00000100:00100000:3.0:1789480093.634535:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931008 00000100:00100000:3.0:1789480093.634604:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1789480093.634614:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+44:2401:x1876405507931008:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480093.634646:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480093.634675:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243dd78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d01 expref: 44 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.634694:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.634699:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480093.634753:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+43:2401:x1876405507931008:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 141us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.634760:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1789480093.686660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480093.686886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931264 00000100:00100000:1.0:1789480093.686896:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931264 00000100:00100000:1.0:1789480093.686959:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:1.0:1789480093.686972:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12292:x1876405507931264:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1789480093.687003:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480093.687007:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789480093.687036:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243dcde lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cd7 expref: 43 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687054:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:1.0:1789480093.687060:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789480093.687075:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dd86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d08 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687251:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687279:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 43 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687289:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687327:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 43 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.687362:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 43 pid: 8915 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.687377:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527929984:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480093.687495:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829ed300 going to sleep for 11 seconds 00000100:00100000:1.0:1789480093.691657:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.691759:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527929984:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480093.691789:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.692033:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931392 00000100:00100000:2.0:1789480093.692040:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931392 00010000:00010000:2.0:1789480093.692078:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 44 pid: 8915 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480093.692115:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 83 00000100:00100000:2.0:1789480093.692124:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+44:2402:x1876405507931392:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480093.692160:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480093.692168:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 44 pid: 8915 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692180:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 44 pid: 8915 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692229:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243dd5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cfa expref: 44 pid: 8915 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692246:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480093.692251:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692261:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692270:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480093.692299:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480093.692358:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+43:2402:x1876405507931392:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 234us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480093.692366:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 83 00010000:00010000:3.0:1789480093.692449:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.692457:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480093.692475:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789480093.692648:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243dd86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.692665:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.692673:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.692676:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480093.692685:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd800, rc 0) 00000100:00100000:3.0:1789480093.692725:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12292:x1876405507931264:12345-192.168.206.44@tcp:101:dd.0 Request processed in 5744us (6079us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789480093.692733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 167 00000100:00100000:2.0:1789480093.701117:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.701294:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931520 00000100:00100000:3.0:1789480093.701306:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931520 00000100:00100000:3.0:1789480093.701379:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 168 00000100:00100000:3.0:1789480093.701390:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12292:x1876405507931520:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:3.0:1789480093.701421:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.701446:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243dd9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d0f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701483:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701515:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701631:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243dd9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701654:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.701663:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.701666:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480093.701678:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80031c00, rc 0) 00000100:00100000:3.0:1789480093.701826:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+44:12292:x1876405507931520:12345-192.168.206.44@tcp:101:dd.0 Request processed in 437us (4008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.701834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 168 00000100:00100000:0.0:1789480093.707261:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.707466:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931776 00000100:00100000:3.0:1789480093.707478:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931776 00000100:00100000:3.0:1789480093.707552:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 169 00000100:00100000:3.0:1789480093.707563:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+44:12292:x1876405507931776:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:3.0:1789480093.707784:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.707805:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.707817:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480093.707856:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789480093.707878:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000502bb720 reply state 0000000098c4f011 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.707903:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.707910:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.707913:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480093.707918:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480093.708144:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+47:12292:x1876405507931776:12345-192.168.206.44@tcp:36:dd.0 Request processed in 582us (891us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789480093.708152:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 169 00000020:00080000:3.0:1789480093.708157:0:8915:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480093.936798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.937026:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507931904 00000100:00100000:3.0:1789480093.937037:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507931904 00000100:00100000:3.0:1789480093.937099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 170 00000100:00100000:3.0:1789480093.937109:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+47:12306:x1876405507931904:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:3.0:1789480093.937146:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480093.937172:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243ddb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d16 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937274:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937291:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937304:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937316:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937324:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937331:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937395:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937408:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937433:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937468:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.937483:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 48 pid: 6520 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480093.937497:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527930112:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480093.937608:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480093.943801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.943916:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6520:1876405527930112:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480093.943950:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480093.944311:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507932160 00000100:00100000:1.0:1789480093.944319:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507932160 00000100:00100000:1.0:1789480093.944376:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1789480093.944386:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+49:6179:x1876405507932160:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480093.944666:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+50:6179:x1876405507932160:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 281us (873us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789480093.944675:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1789480093.947976:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480093.948107:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507932288 00000100:00100000:3.0:1789480093.948117:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507932288 00010000:00010000:3.0:1789480093.948169:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 50 pid: 6520 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480093.948237:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 84 00000100:00100000:3.0:1789480093.948248:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+50:2402:x1876405507932288:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480093.948264:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480093.948272:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 50 pid: 6520 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948297:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 50 pid: 6520 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948321:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243dd8d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d08 expref: 50 pid: 6520 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948337:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480093.948342:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948353:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948362:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480093.948400:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480093.948458:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+49:2402:x1876405507932288:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480093.948466:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 84 00010000:00010000:1.0:1789480093.948913:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.948923:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480093.948974:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789480093.948979:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480093.949007:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949021:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949050:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949056:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949062:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80030400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480093.949067:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949075:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949085:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:1.0:1789480093.949088:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.949092:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949099:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030400/0xdaa289fda243ddb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949113:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949119:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949139:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949151:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480093.949154:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949160:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949169:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:1.0:1789480093.949171:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480093.949174:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949264:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031000/0xdaa289fda243ddb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d16 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949280:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d16 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480093.949287:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:1.0:1789480093.949289:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480093.949291:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6aa33c6800, rc 0) 00000100:00100000:1.0:1789480093.949335:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+48:12306:x1876405507931904:12345-192.168.206.44@tcp:101:stat.0 Request processed in 12227us (12546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480093.949342:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 170 00010000:00010000:2.0:1789480094.020356:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480094.024726:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.024822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507932544 00000100:00100000:3.0:1789480094.024833:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507932544 00000100:00100000:3.0:1789480094.024913:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:3.0:1789480094.024925:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+48:12312:x1876405507932544:12345-192.168.206.44@tcp:36:truncate.0 00010000:00010000:3.0:1789480094.024985:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480094.025015:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d16 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.025051:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480094.025057:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480094.025387:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.025405:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.025416:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480094.025459:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789480094.025479:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f503b930 reply state 000000004516d7fa transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.025492:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.025498:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480094.025500:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480094.025503:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480094.025590:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+50:12312:x1876405507932544:12345-192.168.206.44@tcp:36:truncate.0 Request processed in 667us (873us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789480094.025598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 171 00000020:00080000:3.0:1789480094.025604:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1789480094.025671:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480094.185834:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.186092:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507932672 00000100:00100000:3.0:1789480094.186103:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507932672 00000100:00100000:3.0:1789480094.186176:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 172 00000100:00100000:3.0:1789480094.186217:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+50:12326:x1876405507932672:12345-192.168.206.44@tcp:101:stat.0 00010000:00010000:3.0:1789480094.186255:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480094.186279:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d1d expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186345:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186362:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186374:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186396:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186404:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186410:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186478:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186487:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186493:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480094.186531:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789480094.186542:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480094.186565:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186577:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186584:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186591:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186597:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186603:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480094.186607:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186616:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186628:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480094.186631:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480094.186637:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186655:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6600/0xdaa289fda243ddda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186669:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186685:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186691:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186695:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480094.186698:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186705:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186713:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:3.0:1789480094.186716:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480094.186719:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186725:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243dde1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186752:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6800/0xdaa289fda243ddd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 52 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186904:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 51 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.186913:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480094.186916:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480094.186924:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc600, rc 0) 00000100:00100000:3.0:1789480094.186992:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+51:12326:x1876405507932672:12345-192.168.206.44@tcp:101:stat.0 Request processed in 806us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.186999:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 172 00000100:00100000:2.0:1789480094.298474:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480094.301247:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507932928 00000100:00100000:1.0:1789480094.301275:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507932928 00000100:00100000:1.0:1789480094.301348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:1.0:1789480094.301359:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+51:12336:x1876405507932928:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480094.301384:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480094.301409:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243ddef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d24 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480094.301513:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789480094.301618:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243ddef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d24 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.301634:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:1.0:1789480094.301636:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789480094.301642:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd600/0xdaa289fda243ddef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d24 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.301656:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd600, rc 0) 00000100:00100000:1.0:1789480094.301727:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+52:12336:x1876405507932928:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 369us (3262us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1789480094.301734:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:0.0:1789480094.305831:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480094.306025:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507933184 00000100:00100000:1.0:1789480094.306035:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507933184 00000100:00100000:1.0:1789480094.306088:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:1.0:1789480094.306098:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+52:12336:x1876405507933184:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1789480094.306356:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+53:12336:x1876405507933184:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 259us (533us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789480094.306365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:2.0:1789480094.373180:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480094.373312:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507933440 00000100:00100000:0.0:1789480094.373323:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507933440 00000100:00100000:0.0:1789480094.373387:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:0.0:1789480094.373399:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+53:12342:x1876405507933440:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480094.373430:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480094.373456:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243ddfd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d2b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.373565:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.373583:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 54 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.373594:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.373632:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 54 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.373647:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 54 pid: 8915 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.373662:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527930240:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480094.373792:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480094.380802:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527930240:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480094.380802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00010000:00010000:2.0:1789480094.380832:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.380898:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507933568 00000100:00100000:3.0:1789480094.380906:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507933568 00010000:00010000:3.0:1789480094.380940:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 55 pid: 8915 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.380973:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 85 00000100:00100000:3.0:1789480094.380985:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+55:2401:x1876405507933568:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480094.381002:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480094.381009:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 55 pid: 8915 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381021:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 55 pid: 8915 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381061:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243dde8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d1d expref: 55 pid: 8915 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381077:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480094.381082:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381094:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381375:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.381432:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480094.381490:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+54:2401:x1876405507933568:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 508us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.381498:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 85 00010000:00010000:0.0:1789480094.381601:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.381619:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480094.381637:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789480094.381763:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243ddfd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.381780:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.381788:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.381791:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789480094.381794:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da800, rc 0) 00000100:00100000:0.0:1789480094.381836:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+54:12342:x1876405507933440:12345-192.168.206.44@tcp:101:bash.0 Request processed in 8440us (8665us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789480094.381844:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 174 00000100:00100000:0.0:1789480094.394090:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480094.394256:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507933824 00000100:00100000:2.0:1789480094.394268:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507933824 00000100:00100000:2.0:1789480094.394335:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:2.0:1789480094.394346:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+54:12342:x1876405507933824:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:2.0:1789480094.394760:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.394782:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.394794:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480094.394837:0:12158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1789480094.394859:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000631602fd reply state 00000000a76c028b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.394873:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.394895:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480094.394898:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480094.394903:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480094.394998:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+57:12342:x1876405507933824:12345-192.168.206.44@tcp:36:bash.0 Request processed in 653us (916us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789480094.395021:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 175 00000020:00080000:2.0:1789480094.396511:0:12158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789480094.405090:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527930496:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405166:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405220:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527931008:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405243:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405264:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527931520:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405284:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405301:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527932032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480094.405334:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405372:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789480094.405378:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527930368:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405404:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527930880:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405442:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405455:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527931392:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405471:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405483:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527931904:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.405497:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480094.405519:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931392 00000100:00100000:0.0:1789480094.405526:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931392 00000100:00100000:0.0:1789480094.405572:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931904 00000100:00100000:0.0:1789480094.405575:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931904 00000100:00100000:1.0:1789480094.405791:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527930752:0@lo:400:kworker.0 00000100:00100000:1.0:1789480094.405819:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480094.405834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527931264:0@lo:400:kworker.0 00000100:00100000:1.0:1789480094.405848:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.406227:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527930624:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.406280:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527931136:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406301:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.406332:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527931648:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406370:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.406397:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527930368 00000100:00100000:3.0:1789480094.406401:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527930368 00000100:00100000:3.0:1789480094.406431:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789480094.406440:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527930368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406494:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527930368:12345-0@lo:400:kworker.0 Request processed in 56us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.406502:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789480094.406534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527932032 00000100:00100000:3.0:1789480094.406538:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527932032 00000100:00100000:3.0:1789480094.406554:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527930880 00000100:00100000:3.0:1789480094.406557:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527930880 00000100:00100000:3.0:1789480094.406566:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527930624 00000100:00100000:3.0:1789480094.406568:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527930624 00000100:00100000:3.0:1789480094.406580:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789480094.406586:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527932032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480094.406627:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789480094.406665:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527932032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.406671:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789480094.406682:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789480094.406687:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527930880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406712:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527930880:12345-0@lo:400:kworker.0 Request processed in 26us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.406718:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789480094.406728:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789480094.406733:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527930624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406763:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527930624:12345-0@lo:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.406769:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789480094.406802:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527930624:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406831:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527930368:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406840:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527930880:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.406853:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527932032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480094.406876:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527930496 00000100:00100000:3.0:1789480094.406880:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527930496 00000100:00100000:3.0:1789480094.406898:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931008 00000100:00100000:3.0:1789480094.406901:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931008 00000100:00100000:3.0:1789480094.406915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931520 00000100:00100000:3.0:1789480094.406917:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931520 00000100:00100000:3.0:1789480094.406926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527930752 00000100:00100000:3.0:1789480094.406928:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527930752 00000100:00100000:3.0:1789480094.406936:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931136 00000100:00100000:3.0:1789480094.406945:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931136 00000100:00100000:3.0:1789480094.406962:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931648 00000100:00100000:3.0:1789480094.406964:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931648 00000100:00100000:3.0:1789480094.406978:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789480094.406984:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527930496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407020:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527930496:12345-0@lo:400:kworker.0 Request processed in 36us (1855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789480094.407038:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789480094.407044:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527931008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407073:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527931008:12345-0@lo:400:kworker.0 Request processed in 29us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407078:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789480094.407089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789480094.407095:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527931520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407133:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527931520:12345-0@lo:400:kworker.0 Request processed in 27us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789480094.407151:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789480094.407156:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527930752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407184:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527930752:12345-0@lo:400:kworker.0 Request processed in 27us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407214:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789480094.407225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789480094.407231:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527931136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407276:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527931136:12345-0@lo:400:kworker.0 Request processed in 44us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789480094.407347:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789480094.407354:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407383:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527931648:12345-0@lo:400:kworker.0 Request processed in 30us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.407388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00080000:3.0:1789480094.407415:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888cf480 x1876405527931136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480094.407426:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527931136:0@lo:400:kworker.0 00010000:00080000:3.0:1789480094.407434:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2fb80 x1876405527931648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480110 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480094.407442:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527931648:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407469:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527930496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407478:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527931008:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407488:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527931520:0@lo:400:kworker.0 00000100:00100000:3.0:1789480094.407561:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.407580:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507933952 00000100:00100000:3.0:1789480094.407585:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507933952 00000100:00100000:3.0:1789480094.407609:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:3.0:1789480094.407615:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+57:12342:x1876405507933952:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480094.407631:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480094.407653:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243de19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d32 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.407742:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.407759:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.407769:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.407801:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.407815:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480094.407826:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527932160:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480094.407884:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480094.410285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527931776:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.410394:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931264 00000100:00100000:0.0:1789480094.410403:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931264 00000100:00100000:0.0:1789480094.410460:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789480094.410470:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527931392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.410552:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527931392:12345-0@lo:400:kworker.0 Request processed in 83us (5077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.410559:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789480094.410577:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789480094.410584:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527931904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.410685:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527931904:12345-0@lo:400:kworker.0 Request processed in 102us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.410692:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789480094.410704:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789480094.410710:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527931264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.410751:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527931264:12345-0@lo:400:kworker.0 Request processed in 42us (4901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.410758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789480094.410782:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480094.410787:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480094.410790:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480094.410793:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480094.410830:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527931392:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.410843:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527931904:0@lo:400:kworker.0 00000100:00100000:1.0:1789480094.411300:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480094.411354:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527930752:0@lo:400:kworker.0 00000100:00100000:1.0:1789480094.411365:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527931264:0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.411490:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527931776 00000100:00100000:0.0:1789480094.411496:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527931776 00000100:00100000:0.0:1789480094.411542:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789480094.411549:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527931776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480094.411585:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527931776:12345-0@lo:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.411604:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789480094.411834:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527931776:0@lo:400:kworker.0 00000100:00080000:2.0:1789480094.411897:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480094.417144:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480094.417314:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507934080 00000100:00100000:1.0:1789480094.417324:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507934080 00010000:00010000:1.0:1789480094.417366:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 59 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480094.417410:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:1.0:1789480094.417421:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:2401:x1876405507934080:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480094.417438:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480094.417446:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 59 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.417461:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 59 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.417487:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:1.0:1789480094.417493:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.417528:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.417536:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.417558:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480094.417620:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:2401:x1876405507934080:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 201us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.417628:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00010000:00010000:0.0:1789480094.417873:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de04 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d2b expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.417891:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527932160:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480094.417928:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.417938:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.417944:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480094.418001:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789480094.418006:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480094.418052:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.418083:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc600/0xdaa289fda243de19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d32 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.418099:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d32 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.418107:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.418110:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480094.418113:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc800, rc 0) 00000100:00100000:0.0:1789480094.418167:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+57:12342:x1876405507933952:12345-192.168.206.44@tcp:101:bash.0 Request processed in 10551us (10607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.418175:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:3.0:1789480094.422444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480094.422541:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507934336 00000100:00100000:1.0:1789480094.422552:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507934336 00000100:00100000:1.0:1789480094.422616:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:1.0:1789480094.422627:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+57:12342:x1876405507934336:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1789480094.422873:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12342:x1876405507934336:12345-192.168.206.44@tcp:35:bash.0 Request processed in 246us (436us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789480094.422889:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:1.0:1789480094.534920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.535057:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507934592 00000100:00100000:3.0:1789480094.535068:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507934592 00000100:00100000:3.0:1789480094.535149:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:3.0:1789480094.535161:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12352:x1876405507934592:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480094.535227:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480094.535251:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243de27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d39 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480094.535386:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789480094.535493:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243de27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d39 expref: 60 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.535523:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:3.0:1789480094.535527:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480094.535533:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243de27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d39 expref: 60 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.535547:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecda00, rc 0) 00000100:00100000:3.0:1789480094.535602:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12352:x1876405507934592:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 443us (697us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789480094.535609:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 177 00000100:00100000:3.0:1789480094.544351:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480094.544525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507934720 00000100:00100000:0.0:1789480094.544535:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507934720 00000100:00100000:0.0:1789480094.544612:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 178 00000100:00100000:0.0:1789480094.544623:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12352:x1876405507934720:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:0.0:1789480094.544707:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544728:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544741:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544766:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544788:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544795:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544866:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544876:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544894:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480094.544942:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544954:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544960:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544967:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.544973:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.544977:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545456:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545475:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480094.545478:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.545484:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545491:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545505:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545512:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545518:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545523:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.545526:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545532:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545539:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:0.0:1789480094.545542:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.545545:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545748:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545760:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545765:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545951:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545957:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.545960:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545967:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545976:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.545979:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.545981:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.545987:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.546148:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12352:x1876405507934720:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1523us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.546157:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 178 00000100:00100000:1.0:1789480094.550580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.550717:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507934976 00000100:00100000:3.0:1789480094.550728:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507934976 00000100:00100000:3.0:1789480094.550982:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1789480094.551005:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12352:x1876405507934976:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480094.551268:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+60:12352:x1876405507934976:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 276us (697us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789480094.551276:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:1.0:1789480094.602069:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480094.602401:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507935232 00000100:00100000:0.0:1789480094.602411:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507935232 00000100:00100000:0.0:1789480094.602474:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:0.0:1789480094.602485:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+60:12355:x1876405507935232:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480094.602512:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480094.602534:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d40 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602621:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602638:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602649:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602659:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602666:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602781:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243de5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602791:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243de5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602816:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243de5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480094.602826:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480094.602912:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602920:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602927:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602933:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.602937:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602946:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602959:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480094.602962:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.602968:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602974:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602988:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.602994:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603005:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603010:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.603013:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603019:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603027:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:0.0:1789480094.603029:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.603031:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603037:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243de58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603071:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d40 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603086:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243de5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d40 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.603092:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.603094:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480094.603096:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dba00, rc 0) 00000100:00100000:0.0:1789480094.603169:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+62:12355:x1876405507935232:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 686us (1109us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789480094.603187:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 179 00000100:00100000:2.0:1789480094.608015:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480094.608098:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480094.608298:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507935360 00000100:00100000:0.0:1789480094.608308:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507935360 00000100:00100000:0.0:1789480094.608368:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:0.0:1789480094.608379:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:12355:x1876405507935360:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:0.0:1789480094.608465:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608487:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608500:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608548:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608555:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608563:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608569:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.608574:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608583:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608596:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.608610:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480094.608617:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.608623:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480094.608777:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+62:12355:x1876405507935360:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 387us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.608784:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 180 00000100:00100000:1.0:1789480094.609062:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507935488 00000100:00100000:1.0:1789480094.609068:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507935488 00000100:00100000:1.0:1789480094.609116:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:1.0:1789480094.609135:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+62:2400:x1876405507935488:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480094.609146:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480094.609163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243de5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d40 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480094.609183:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:1.0:1789480094.609187:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480094.609236:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+61:2400:x1876405507935488:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 113us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480094.609242:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1789480094.612249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480094.612412:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507935744 00000100:00100000:2.0:1789480094.612422:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507935744 00000100:00100000:2.0:1789480094.612516:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:2.0:1789480094.612526:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+61:12355:x1876405507935744:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480094.612762:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+62:12355:x1876405507935744:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 236us (520us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789480094.612770:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:1.0:1789480094.818405:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480094.818515:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936000 00000100:00100000:0.0:1789480094.818527:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936000 00000100:00100000:0.0:1789480094.818703:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:0.0:1789480094.818715:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+62:12373:x1876405507936000:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1789480094.818745:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480094.818781:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d47 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.818888:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.818905:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.818919:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480094.818931:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480094.819029:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243de74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d47 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.819067:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d47 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.819076:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.819079:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789480094.819083:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db200, rc 0) 00000100:00100000:0.0:1789480094.819156:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12373:x1876405507936000:12345-192.168.206.44@tcp:101:cat.0 Request processed in 443us (760us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789480094.819164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:0.0:1789480094.856288:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.856424:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936128 00000100:00100000:3.0:1789480094.856436:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936128 00000100:00100000:3.0:1789480094.856500:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:3.0:1789480094.856524:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12374:x1876405507936128:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480094.856632:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480094.856658:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243de89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d4e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.856731:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.856749:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.857052:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480094.857096:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789480094.857099:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480094.857221:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.857250:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243de89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d4e expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.857268:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d4e expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.857278:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480094.857280:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480094.857285:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd800, rc 0) 00000100:00100000:3.0:1789480094.857398:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12374:x1876405507936128:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 877us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.857418:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:1.0:1789480094.865065:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.865701:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936512 00000100:00100000:3.0:1789480094.865712:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936512 00000100:00100000:3.0:1789480094.866066:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:3.0:1789480094.866079:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12374:x1876405507936512:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480094.866394:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12374:x1876405507936512:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 318us (1337us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789480094.866403:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:1.0:1789480094.872391:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480094.872486:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936640 00000100:00100000:3.0:1789480094.872617:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936640 00000100:00100000:3.0:1789480094.872726:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1789480094.872737:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12374:x1876405507936640:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:3.0:1789480094.872753:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789480094.872780:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243de20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d32 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.872801:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243de7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d47 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.872814:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7e00/0xdaa289fda243dd1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cec expref: 64 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480094.872823:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480094.872829:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480094.872895:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12374:x1876405507936640:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 159us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.872919:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:0.0:1789480094.875042:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480094.876658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936768 00000100:00100000:2.0:1789480094.876672:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936768 00000100:00100000:2.0:1789480094.876778:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:2.0:1789480094.876789:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12374:x1876405507936768:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:2.0:1789480094.876918:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.876938:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480094.876952:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480094.877076:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789480094.877167:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12374:x1876405507936768:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 380us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.877208:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 183 00000100:00100000:1.0:1789480094.914618:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480094.917115:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480094.917150:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527932288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480094.917245:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480094.917328:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527932288 00000100:00100000:2.0:1789480094.917337:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527932288 00000100:00100000:2.0:1789480094.917383:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789480094.917392:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527932288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480094.917423:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789480094.917468:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527932288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480094.917475:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789480094.917715:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527932416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480094.917744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480094.917806:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527932288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480094.917839:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527932416 00000100:00100000:3.0:1789480094.917843:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527932416 00000100:00100000:3.0:1789480094.917867:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789480094.917874:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527932416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480094.917895:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789480094.917927:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527932416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480094.917933:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789480094.917960:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527932416:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480094.918882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507936896 00000100:00100000:0.0:1789480094.918893:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507936896 00000100:00100000:0.0:1789480094.918947:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 184 00000100:00100000:0.0:1789480094.918957:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12376:x1876405507936896:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480094.918974:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480094.918998:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d55 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919226:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919244:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919258:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919363:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919450:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919460:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919467:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480094.919508:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789480094.919512:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480094.919530:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919542:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919550:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919556:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919574:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919581:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.919585:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919593:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919608:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480094.919611:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.919617:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919624:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dea5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919642:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919648:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919654:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919659:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480094.919662:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919677:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:0.0:1789480094.919688:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480094.919691:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919727:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243de9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919741:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480094.919748:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480094.919750:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480094.919752:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db000, rc 0) 00000100:00100000:0.0:1789480094.919820:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12376:x1876405507936896:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 865us (5211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480094.919828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 184 00000040:00080000:0.0:1789480095.044411:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480095.044420:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480095.044533:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789480095.044541:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789480095.045035:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480095.045296:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527932544:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480095.045429:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480095.050861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.052108:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507937024 00000100:00100000:3.0:1789480095.052132:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507937024 00000100:00100000:3.0:1789480095.052721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:3.0:1789480095.052734:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937024:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480095.052772:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480095.052915:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937024:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 183us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.052923:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 185 00000100:00100000:0.0:1789480095.058097:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527932544:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789480095.059672:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.059819:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507937152 00000100:00100000:0.0:1789480095.059829:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507937152 00000100:00100000:0.0:1789480095.059893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:0.0:1789480095.059903:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12387:x1876405507937152:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.060092:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060112:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060135:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060151:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060159:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060165:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060217:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060227:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060234:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480095.060285:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789480095.060289:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480095.060300:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060311:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060318:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060324:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060330:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.060334:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060342:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060354:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:0.0:1789480095.060357:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480095.060363:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060369:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243deba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060384:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060401:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060407:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060412:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.060416:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060431:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8a6abb541100) 00010000:00010000:0.0:1789480095.060433:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480095.060436:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060441:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243dec1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060456:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060463:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060469:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060474:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.060484:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060615:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060628:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480095.060631:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480095.060634:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.060642:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dec8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.060763:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12387:x1876405507937152:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 859us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.060771:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 186 00000100:00100000:3.0:1789480095.065935:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.071725:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507937408 00000100:00100000:0.0:1789480095.071742:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507937408 00000100:00100000:0.0:1789480095.071871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:0.0:1789480095.071883:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12387:x1876405507937408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.071906:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480095.071928:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243decf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d5c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072037:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072096:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480095.072109:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480095.072226:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072235:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072242:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072248:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.072253:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072262:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072274:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480095.072277:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480095.072283:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072289:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243ded6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072332:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243decf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d5c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072358:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:0.0:1789480095.072360:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480095.072364:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243decf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d5c expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.072374:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dac00, rc 0) 00000100:00100000:0.0:1789480095.072450:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 568us (6523us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1789480095.072459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 187 00000100:00100000:3.0:1789480095.076381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.076464:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507937536 00000100:00100000:0.0:1789480095.076480:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507937536 00000100:00100000:0.0:1789480095.076543:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:0.0:1789480095.076565:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937536:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789480095.076614:0:12158:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789480095.076742:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937536:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 189us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.076750:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 188 00000100:00100000:2.0:1789480095.079900:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.080238:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507937792 00000100:00100000:0.0:1789480095.080250:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507937792 00000100:00100000:0.0:1789480095.080313:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:0.0:1789480095.080325:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507937792:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.080350:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480095.080354:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789480095.080387:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd800/0xdaa289fda243de90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d4e expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.080426:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480095.080432:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480095.080448:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dee4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d63 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789480095.080815:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789480095.080957:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.081435:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.081449:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.081510:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243dee4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d63 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.081526:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d63 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.081534:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6abb541100) 00010000:00010000:0.0:1789480095.081536:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480095.081539:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dbe00, rc 0) 00000100:00100000:0.0:1789480095.081646:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12387:x1876405507937792:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1322us (1763us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789480095.081654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 189 00000100:00100000:3.0:1789480095.090706:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.092102:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938048 00000100:00100000:0.0:1789480095.092115:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938048 00000100:00100000:0.0:1789480095.092251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:0.0:1789480095.092262:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12387:x1876405507938048:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.092324:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.092354:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243deeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d63 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092372:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6abb541100) 00010000:00010000:0.0:1789480095.092382:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480095.092404:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092419:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092430:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092474:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092481:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092488:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092540:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092560:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092567:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092573:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.092578:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092586:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092594:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480095.092597:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480095.092601:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092607:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243def9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092617:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092623:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092628:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092633:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480095.092641:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092647:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092655:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xcd32a763 (ffff8a6abb541000) 00010000:00010000:0.0:1789480095.092658:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480095.092661:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.092666:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df00 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xcd32a763 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.092751:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507938048:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 490us (2055us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480095.092758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 190 00000100:00100000:3.0:1789480095.097146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.097185:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938176 00000100:00100000:3.0:1789480095.097211:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938176 00000100:00100000:3.0:1789480095.097263:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:3.0:1789480095.097273:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12387:x1876405507938176:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480095.097295:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480095.097319:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d6a expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097354:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097369:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097382:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097489:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 67 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097520:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 66 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.097528:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480095.097531:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480095.097535:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecda00, rc 0) 00000100:00100000:3.0:1789480095.097595:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12387:x1876405507938176:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 323us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.097603:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 191 00000100:00100000:2.0:1789480095.100783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.101422:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938432 00000100:00100000:3.0:1789480095.101434:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938432 00000100:00100000:3.0:1789480095.101509:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:3.0:1789480095.101520:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12387:x1876405507938432:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480095.101610:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.101629:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.101643:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480095.102096:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789480095.102110:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464025919385ns, next at 465025916045ns, rc = 0 00000004:00010000:3.0:1789480095.102174:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aabd78ea reply state 0000000000ca2756 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.102206:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.102216:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480095.102219:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789480095.102223:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480095.102316:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12387:x1876405507938432:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 796us (1550us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789480095.102324:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 192 00000100:00100000:3.0:1789480095.111059:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.111150:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938560 00000100:00100000:0.0:1789480095.111160:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938560 00000100:00100000:0.0:1789480095.111232:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:0.0:1789480095.111242:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12387:x1876405507938560:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.111271:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480095.111293:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d71 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.111351:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 69 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.111367:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 69 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.111394:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:0.0:1789480095.111397:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480095.111402:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dac00, rc 0) 00000100:00100000:0.0:1789480095.111465:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+69:12387:x1876405507938560:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 224us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.111472:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 193 00000100:00100000:3.0:1789480095.121238:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480095.121370:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938688 00000100:00100000:2.0:1789480095.121381:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938688 00000100:00100000:2.0:1789480095.121466:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1789480095.121478:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+6:2401:x1876405507938688:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789480095.121711:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507938688:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 235us (482us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789480095.121719:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00080000:0.0:1789480095.121839:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480095.134803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480095.134881:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507938944 00000100:00100000:1.0:1789480095.134891:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507938944 00000100:00100000:1.0:1789480095.134954:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:1.0:1789480095.135296:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+69:12387:x1876405507938944:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789480095.135527:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12387:x1876405507938944:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 237us (731us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789480095.135536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:3.0:1789480095.139429:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.139507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939200 00000100:00100000:0.0:1789480095.139518:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939200 00000100:00100000:0.0:1789480095.139575:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:0.0:1789480095.139584:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12387:x1876405507939200:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789480095.139693:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12387:x1876405507939200:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.139702:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 194 00000100:00100000:0.0:1789480095.142977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480095.143161:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939328 00000100:00100000:1.0:1789480095.143173:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939328 00000100:00100000:1.0:1789480095.143251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:1.0:1789480095.143262:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12387:x1876405507939328:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480095.143287:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480095.143310:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243df23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d78 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143389:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143404:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143416:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480095.143455:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480095.143471:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143495:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243df23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d78 expref: 72 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143511:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d78 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.143519:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:1.0:1789480095.143522:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789480095.143526:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd000, rc 0) 00000100:00100000:1.0:1789480095.143596:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12387:x1876405507939328:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480095.143603:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 195 00000100:00100000:1.0:1789480095.149531:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.149605:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939456 00000100:00100000:3.0:1789480095.149617:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939456 00000100:00100000:3.0:1789480095.149688:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1789480095.149699:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507939456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480095.149720:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480095.149743:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d7f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480095.149768:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94c9e, blocks: 0x0 00010000:00010000:3.0:1789480095.149791:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789480095.149807:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480095.149818:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.149839:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.149853:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecce00, rc 0) 00000100:00100000:3.0:1789480095.149907:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507939456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 209us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.149915:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1789480095.156950:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.157005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939712 00000100:00100000:0.0:1789480095.157016:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939712 00000100:00100000:0.0:1789480095.157091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:0.0:1789480095.157102:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12387:x1876405507939712:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789480095.157242:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12387:x1876405507939712:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 141us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.157250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 196 00000100:00100000:0.0:1789480095.167297:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480095.167393:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939840 00000100:00100000:2.0:1789480095.167403:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939840 00000100:00100000:2.0:1789480095.167464:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:2.0:1789480095.167475:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:12387:x1876405507939840:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480095.167511:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480095.167533:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d86 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.167569:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.167580:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480095.167584:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480095.167590:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.167642:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.167658:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.167673:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527932672:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480095.167759:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480095.169857:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527932672:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480095.169903:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.169924:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1000, rc 0) 00000100:00100000:2.0:1789480095.169993:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:12387:x1876405507939840:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2518us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480095.170001:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:3.0:1789480095.170780:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.170876:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507939968 00000100:00100000:0.0:1789480095.170948:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507939968 00010000:00010000:0.0:1789480095.170983:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.171055:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:0.0:1789480095.171065:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507939968:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.171079:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.171099:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.171113:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.171149:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c947c2d/0xdaa289fda243df31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d7f expref: 9 pid: 8435 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.171165:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480095.171170:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480095.171179:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.171218:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.171258:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.171283:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876405527932800:192.168.206.44@tcp:105: 00000100:00100000:0.0:1789480095.171358:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.180399:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.180446:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940096 00000100:00100000:3.0:1789480095.180456:0:8440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940096 00002000:00100000:3.0:1789480095.180506:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a69888cf100 x1876405507940096/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:246/0 lens 504/0 e 0 to 0 dl 1789480106 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480095.180517:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a69888cf100 with x1876405507940096 ext(0->8) 00002000:00010000:3.0:1789480095.180523:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a69888cf100 00000100:00100000:3.0:1789480095.180550:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1789480095.180559:0:8440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507940096:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789480095.181465:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6507:1876405527932800:192.168.206.44@tcp:105: 00010000:00010000:1.0:1789480095.181490:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480095.181556:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2401:x1876405507939968:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 10492us (10778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480095.181577:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:3.0:1789480095.182186:0:8440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2402:x1876405507940096:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 1624us (1791us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789480095.182231:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00002000:00100000:3.0:1789480095.182243:0:8440:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a69888cf100 x1876405507940096/t4294967315(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:246/0 lens 504/448 e 0 to 0 dl 1789480106 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789480095.182252:0:8440:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a69888cf100 with x1876405507940096 ext(0->8) 00002000:00010000:3.0:1789480095.182258:0:8440:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a69888cf100 00000100:00100000:3.0:1789480095.184797:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480095.184996:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940224 00000100:00100000:2.0:1789480095.185006:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940224 00000100:00100000:2.0:1789480095.185169:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:2.0:1789480095.185179:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12387:x1876405507940224:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789480095.187436:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1789480095.187453:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1789480095.187513:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789480095.187529:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6987474780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789480095.187533:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a99147500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a69874746c0 00000020:00080000:1.0:1789480095.187537:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a99147600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6988837000 00000020:00080000:1.0:1789480095.187637:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1789480095.187692:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789480095.187701:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480095.187719:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527932928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789480095.187811:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480095.187948:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12387:x1876405507940224:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 2769us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480095.187958:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 197 00000100:00100000:3.0:1789480095.188360:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480095.188370:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527933056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789480095.188400:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480095.188426:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527932928 00000100:00100000:3.0:1789480095.188433:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527932928 00000100:00100000:3.0:1789480095.188462:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527933056 00000100:00100000:3.0:1789480095.188464:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527933056 00000100:00100000:3.0:1789480095.188478:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789480095.188486:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527932928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789480095.188511:0:8493:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:3.0:1789480095.188549:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa94c9c, atime: 0x6aa94c9c, ctime: 0x6aa94c9c, blocks: 0x8 00010000:00010000:3.0:1789480095.188558:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.188577:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789480095.188581:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480095.188587:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.188604:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.188614:0:8493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.188622:0:8493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.188639:0:8493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789480095.189370:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527932928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 881us (1555us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789480095.189378:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789480095.189401:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789480095.189410:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527933056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789480095.189496:0:8493:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789480095.189500:0:8493:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789480095 00002000:00010000:3.0:1789480095.189502:0:8493:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789480095.189512:0:8493:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789480094 -> 1789480095 00002000:00010000:3.0:1789480095.189514:0:8493:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789480095.189550:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527933056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (1150us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789480095.189557:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1789480095.189579:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480095.189586:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.189595:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480095.189599:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.189610:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.189629:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.189636:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009725a1e5/0xdaa289fda243df3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.189653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480095.189655:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480095.189656:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789480095.189795:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6987d72d80/2, rc 0, transno 4294967308 00000100:00100000:1.0:1789480095.189802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527932928:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1789480095.189838:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a69888cca80/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789480095.189843:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527933056:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1789480095.190526:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190537:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190544:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190549:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6c00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190554:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190560:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190573:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a6aa31c0a00) 00010000:00010000:2.0:1789480095.190577:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190581:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190587:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6c00/0xdaa289fda243dc60 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190617:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190623:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190630:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190635:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190638:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190643:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190651:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480095.190654:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190656:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190661:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7200/0xdaa289fda243dc67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190684:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190690:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190695:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190706:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190709:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190716:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190724:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1d00) 00010000:00010000:2.0:1789480095.190727:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190730:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190736:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a000/0xdaa289fda243dca6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190753:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190759:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190764:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190769:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190772:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190777:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190795:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480095.190797:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190800:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190805:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031800/0xdaa289fda243dda9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190816:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190821:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190825:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190829:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190832:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190836:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190842:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480095.190844:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190846:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190851:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7400/0xdaa289fda243ddcc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190870:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190875:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190893:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190898:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190901:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190907:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190916:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480095.190918:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.190920:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190926:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243de12 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190936:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190942:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190947:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190958:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.190961:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190966:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190974:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480095.190976:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789480095.190979:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.190984:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc400/0xdaa289fda243df15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.194343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.194416:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940352 00000100:00100000:3.0:1789480095.194427:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940352 00000100:00100000:3.0:1789480095.194477:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:3.0:1789480095.194487:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2402:x1876405507940352:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789480095.197016:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1789480095.197032:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789480095.197463:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507940352:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 2971us (3123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.197474:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1789480095.205461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.205882:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940608 00000100:00100000:0.0:1789480095.205892:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940608 00000100:00100000:0.0:1789480095.205954:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 198 00000100:00100000:0.0:1789480095.205965:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:12387:x1876405507940608:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.206023:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.206054:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243df2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d78 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.206073:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:0.0:1789480095.206079:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480095.206112:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.206141:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.206152:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480095.206585:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a43b062 reply state 0000000003d163cb transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.206598:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.206604:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:0.0:1789480095.206618:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480095.206621:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480095.207153:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+20:12387:x1876405507940608:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 1186us (1699us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1789480095.207162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 198 00000100:00100000:0.0:1789480095.215374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.215457:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940736 00000100:00100000:3.0:1789480095.215468:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940736 00000100:00100000:3.0:1789480095.215541:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:3.0:1789480095.215552:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507940736:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789480095.215709:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789480095.215712:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789480095 -> 1789480094 00002000:00010000:3.0:1789480095.215715:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789480092 00002000:00010000:3.0:1789480095.215717:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789480095 -> 1789480094 00002000:00010000:3.0:1789480095.215719:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789480095.215775:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507940736:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 225us (410us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789480095.215782:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:1.0:1789480095.223774:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.224845:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507940992 00000100:00100000:0.0:1789480095.224857:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507940992 00000100:00100000:0.0:1789480095.224934:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:0.0:1789480095.224945:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+20:12387:x1876405507940992:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.225044:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.225072:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 20 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.225082:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.225129:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 20 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.225145:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 20 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.225160:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527933184:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480095.225413:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480095.231273:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527933184:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480095.231329:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.231669:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.231825:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941120 00000100:00100000:0.0:1789480095.231833:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941120 00010000:00010000:0.0:1789480095.231870:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 21 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.231911:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:0.0:1789480095.231921:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+21:2402:x1876405507941120:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.231938:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.231946:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 21 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.231958:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 21 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.231982:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243df0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d6a expref: 21 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.231998:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:0.0:1789480095.232003:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.232013:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.232022:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.232065:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480095.232137:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+20:2402:x1876405507941120:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 217us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.232144:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00010000:00010000:1.0:1789480095.232431:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232445:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232495:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232503:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232510:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232516:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480095.232521:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232529:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232540:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:1.0:1789480095.232542:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789480095.232547:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.232552:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243df4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.232607:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:12387:x1876405507940992:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 7663us (8841us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789480095.232614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 199 00000100:00100000:1.0:1789480095.237764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.237856:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941248 00000100:00100000:0.0:1789480095.237867:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941248 00000100:00100000:0.0:1789480095.238015:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:0.0:1789480095.238026:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507941248:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789480095.238078:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.238100:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.238111:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480095.238116:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480095.238131:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.238171:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.238185:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 8 pid: 8436 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.238235:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527933312:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480095.238324:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.245056:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480095.245227:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527933312:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480095.245256:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.245404:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941376 00000100:00100000:2.0:1789480095.245412:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941376 00010000:00010000:2.0:1789480095.245447:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.245486:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:2.0:1789480095.245504:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507941376:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480095.245519:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480095.245539:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.245553:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.245605:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243df38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d86 expref: 9 pid: 8436 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.245621:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480095.245626:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480095.245632:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.245642:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.245672:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480095.245819:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245829:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245862:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245871:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245881:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245889:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480095.245894:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245904:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245917:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.245925:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046fe7b7d/0xdaa289fda243df54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480095.246010:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507941248:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 7986us (8255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.246019:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:2.0:1789480095.246365:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507941376:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 862us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480095.246373:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:3.0:1789480095.251733:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480095.251825:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941632 00000100:00100000:1.0:1789480095.251836:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941632 00000100:00100000:1.0:1789480095.251905:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 200 00000100:00100000:1.0:1789480095.251916:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+19:12387:x1876405507941632:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789480095.251994:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.252013:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.252022:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.252058:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.252073:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 19 pid: 6522 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.252092:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933440:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480095.252179:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa37209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.256058:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.256152:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941760 00000100:00100000:0.0:1789480095.256162:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941760 00010000:00010000:0.0:1789480095.256232:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 20 pid: 6522 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.256272:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 90 00000100:00100000:0.0:1789480095.256283:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+20:2401:x1876405507941760:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.256299:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.256307:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 20 pid: 6522 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.256322:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 20 pid: 6522 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.256347:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480095.256353:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.256365:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.256374:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.256395:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480095.256443:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+20:2401:x1876405507941760:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 161us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.256450:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 90 00010000:00010000:1.0:1789480095.257250:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031c00/0xdaa289fda243dda2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d0f expref: 19 pid: 6522 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.257283:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933440:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480095.257306:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257316:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257322:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257484:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257497:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 19 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257507:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257542:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 19 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480095.257557:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 19 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480095.257571:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933568:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480095.257644:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8bcd8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.260788:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480095.260953:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933568:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480095.260980:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.261141:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507941888 00000100:00100000:0.0:1789480095.261150:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507941888 00010000:00010000:0.0:1789480095.261185:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 20 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.261250:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 91 00000100:00100000:0.0:1789480095.261259:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+20:2401:x1876405507941888:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.261274:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.261281:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 20 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261294:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 20 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261317:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243df1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d71 expref: 20 pid: 12158 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261334:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:0.0:1789480095.261339:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261351:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261359:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.261391:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480095.261436:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:2401:x1876405507941888:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 178us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.261455:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 91 00010000:00010000:3.0:1789480095.262871:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.262896:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480095.263000:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789480095.263128:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1789480095.263166:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789480095.263265:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527933696:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789480095.263360:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480095.263391:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9240 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.263415:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527933696 00000100:00100000:3.0:1789480095.263422:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527933696 00000100:00100000:3.0:1789480095.263462:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789480095.263471:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527933696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789480095.263551:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8669d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527933696:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.263558:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789480095.264052:0:8915:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1789480095.264057:0:8915:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a69888cca80, transno 4294967316 00000100:00100000:3.0:1789480095.264077:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527933696:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789480095.264217:0:8915:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1789480095.264264:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527933824:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789480095.264295:0:8915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480095.264323:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789480095.267821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527933824 00000100:00100000:2.0:1789480095.267835:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527933824 00000100:00100000:2.0:1789480095.267906:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789480095.267916:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8915:x1876405527933824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789480095.268098:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69810b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8915:x1876405527933824:12345-0@lo:1000:mdt00_003.0 Request processed in 183us (3802us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789480095.268314:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789480095.269308:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8915:1876405527933824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789480095.269364:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269376:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269385:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269392:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.269397:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269405:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269426:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480095.269429:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480095.269434:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269440:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243df62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269464:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269470:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269475:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269490:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.269493:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269499:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269507:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:3.0:1789480095.269509:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480095.269512:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269517:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243de97 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269542:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269557:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.269566:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.270056:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.270076:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 22 pid: 6521 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480095.270105:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987d49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933952:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480095.270332:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480095.279136:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987d49c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527933952:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480095.279168:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.284621:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.285596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507942016 00000100:00100000:0.0:1789480095.285611:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507942016 00010000:00010000:0.0:1789480095.285657:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 23 pid: 6521 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.285707:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 92 00000100:00100000:0.0:1789480095.285718:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:2401:x1876405507942016:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.285737:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.285745:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 23 pid: 6521 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285760:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 23 pid: 6521 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285784:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243deb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d55 expref: 23 pid: 6521 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285800:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:0.0:1789480095.285806:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285817:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285826:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.285888:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480095.285947:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2401:x1876405507942016:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 230us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480095.285955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 92 00010000:00010000:2.0:1789480095.286387:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286397:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286409:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286415:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286421:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286427:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.286432:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286439:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286449:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480095.286452:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.286456:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286462:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243df69 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286484:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286489:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286494:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286499:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.286501:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286507:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286515:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0b00) 00010000:00010000:2.0:1789480095.286518:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480095.286520:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.286526:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243df5b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.286702:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12387:x1876405507941632:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 34787us (34976us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789480095.286711:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 200 00000020:00080000:2.0:1789480095.286717:0:8915:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789480095.287051:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480095.287056:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480095.287614:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789480095.287622:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789480095.290909:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.291036:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507942272 00000100:00100000:3.0:1789480095.291047:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507942272 00000100:00100000:3.0:1789480095.291109:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1789480095.291130:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aaa2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12387:x1876405507942272:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789480095.291655:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789480095.291804:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789480095.291903:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.291923:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.291935:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.291945:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.291951:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.291958:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.292026:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789480095.292128:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aaa2bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+23:12387:x1876405507942272:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 999us (1216us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789480095.292137:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000020:00080000:3.0:1789480095.292143:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789480095.295057:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480095.295084:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.295094:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480095.295099:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.295109:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.295138:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:2.0:1789480095.295141:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789480095.295146:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.295152:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243df70 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.295166:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480095.295167:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480095.295169:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480095.429838:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789480095.671935:0:14668:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480095.671943:0:14668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480095.671964:0:14668:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789480095.671971:0:14668:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480095.812285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.812321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507942528 00000100:00100000:3.0:1789480095.812331:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507942528 00000100:00100000:3.0:1789480095.812382:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:3.0:1789480095.812393:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:12397:x1876405507942528:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480095.812420:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480095.812442:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d8d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.813672:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987eccc00/0xdaa289fda243df7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.813695:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987eccc00/0xdaa289fda243df7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.813708:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987eccc00/0xdaa289fda243df7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480095.813720:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789480095.813828:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d8d expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.813845:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987eccc00/0xdaa289fda243df7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d8d expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.813873:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480095.813876:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480095.813880:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987eccc00, rc 0) 00000100:00100000:3.0:1789480095.815067:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12397:x1876405507942528:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 2669us (2781us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789480095.815079:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 201 00000100:00100000:3.0:1789480095.824792:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.824827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507942656 00000100:00100000:3.0:1789480095.824837:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507942656 00000100:00100000:3.0:1789480095.825054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:3.0:1789480095.825067:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12397:x1876405507942656:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1789480095.825159:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825179:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825233:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825251:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825258:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825264:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825346:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825354:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825360:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480095.825402:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825414:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825420:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825426:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825433:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.825437:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825445:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825457:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480095.825459:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480095.825465:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825477:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243df8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825567:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825573:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825578:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825583:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.825586:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825592:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6aa31c0800) 00010000:00010000:3.0:1789480095.825603:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480095.825606:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825611:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243df93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825625:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.825631:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.826351:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.826356:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecdc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.826360:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.826366:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.826376:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6aa31c0e00) 00010000:00010000:3.0:1789480095.826379:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480095.826382:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.826388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243df9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480095.826483:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12397:x1876405507942656:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 1417us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.826496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 202 00000100:00100000:3.0:1789480095.889269:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480095.889473:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507942912 00000100:00100000:2.0:1789480095.889484:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507942912 00000100:00100000:2.0:1789480095.889712:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:2.0:1789480095.889723:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12400:x1876405507942912:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480095.889793:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480095.889819:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dfa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d94 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891261:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891288:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891303:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891322:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891450:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891459:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891645:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891654:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.891661:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480095.891672:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789480095.892386:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892397:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892418:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892425:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.892430:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892438:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892453:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480095.892457:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.892463:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892469:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243dfa8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892483:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892489:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892561:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892566:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480095.892569:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892584:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892593:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1200) 00010000:00010000:2.0:1789480095.892596:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480095.892599:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892605:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243dfaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892654:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243dfa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 28 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892670:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 27 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.892677:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:2.0:1789480095.892680:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480095.892682:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1400, rc 0) 00000100:00100000:2.0:1789480095.892832:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a862f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12400:x1876405507942912:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 3109us (3588us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789480095.892842:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 203 00000100:00100000:1.0:1789480095.896768:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.896968:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507943040 00000100:00100000:3.0:1789480095.896978:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507943040 00000100:00100000:3.0:1789480095.897087:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:3.0:1789480095.897099:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12400:x1876405507943040:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1789480095.897185:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897242:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897256:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897300:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897308:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897316:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897322:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecdc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480095.897326:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897334:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897347:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:3.0:1789480095.897350:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480095.897356:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.897363:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480095.897446:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12400:x1876405507943040:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 349us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.897460:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 204 00000100:00100000:3.0:1789480095.912873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480095.913530:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507943296 00000100:00100000:1.0:1789480095.913542:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507943296 00000100:00100000:1.0:1789480095.913607:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480095.913618:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12400:x1876405507943296:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1789480095.915334:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb02c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+28:12400:x1876405507943296:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 1710us (2462us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789480095.915347:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1789480095.982566:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.982673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507943552 00000100:00100000:0.0:1789480095.982683:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507943552 00000100:00100000:0.0:1789480095.982750:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:0.0:1789480095.982759:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+28:11932:x1876405507943552:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480095.983027:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480095.983051:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dfcb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2d9b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.983165:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.983181:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 29 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.983228:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.983263:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 29 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.983295:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 29 pid: 8915 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.983309:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527934080:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480095.983398:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480095.986643:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6521:1876405527934080:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480095.986677:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480095.987259:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.987403:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507943680 00000100:00100000:0.0:1789480095.987412:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507943680 00010000:00010000:0.0:1789480095.987457:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 30 pid: 8915 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.987538:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 93 00000100:00100000:0.0:1789480095.987548:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+30:2401:x1876405507943680:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480095.987564:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480095.987572:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 30 pid: 8915 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987586:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 30 pid: 8915 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987608:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243dfb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d94 expref: 30 pid: 8915 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987644:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480095.987648:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987657:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987663:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.987686:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480095.987712:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.987728:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480095.987742:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+29:2401:x1876405507943680:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 195us (484us total) trans 0 rc 0/0 00000004:00200000:2.0:1789480095.987746:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:0.0:1789480095.987749:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 93 00010000:00010000:2.0:1789480095.987890:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dfcb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.987907:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480095.987914:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:2.0:1789480095.987917:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480095.987920:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:2.0:1789480095.987947:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+29:11932:x1876405507943552:12345-192.168.206.44@tcp:101:bash.0 Request processed in 5189us (5458us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789480095.987954:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 205 00000100:00100000:2.0:1789480095.991027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480095.991268:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507943808 00000100:00100000:3.0:1789480095.991279:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507943808 00000100:00100000:3.0:1789480095.991341:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:3.0:1789480095.991353:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+29:11932:x1876405507943808:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480095.991381:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480095.991403:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243dfe0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2da2 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991436:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfe7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991451:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991462:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991577:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243dfe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da2 expref: 31 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991598:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da2 expref: 30 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480095.991607:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:3.0:1789480095.991609:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480095.991614:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecdc00, rc 0) 00000100:00100000:3.0:1789480095.991689:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11932:x1876405507943808:12345-192.168.206.44@tcp:101:bash.0 Request processed in 337us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480095.991696:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 206 00000100:00100000:3.0:1789480095.998918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480095.999001:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944064 00000100:00100000:0.0:1789480095.999012:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944064 00000100:00100000:0.0:1789480095.999082:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 207 00000100:00100000:0.0:1789480095.999093:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+30:11932:x1876405507944064:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:0.0:1789480095.999370:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.999391:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.999404:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480095.999446:0:12158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1789480095.999471:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000071e9b4c reply state 00000000145af270 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.999496:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480095.999503:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480095.999506:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480095.999512:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789480095.999582:0:12158:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1789480095.999681:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+34:11932:x1876405507944064:12345-192.168.206.44@tcp:36:bash.0 Request processed in 590us (777us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789480095.999688:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 207 00000020:00080000:0.0:1789480095.999693:0:12158:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789480096.002174:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.002345:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944192 00000100:00100000:0.0:1789480096.002356:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944192 00000100:00100000:0.0:1789480096.002460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 208 00000100:00100000:0.0:1789480096.002471:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+34:11932:x1876405507944192:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480096.002503:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480096.002525:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dff5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2da9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.002577:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da9 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.002592:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da9 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.002609:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480096.002612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480096.002627:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db600, rc 0) 00000100:00100000:0.0:1789480096.002684:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb4df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+35:11932:x1876405507944192:12345-192.168.206.44@tcp:101:bash.0 Request processed in 215us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480096.002691:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 208 00000100:00080000:2.0:1789480096.003129:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480096.005232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.005321:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944320 00000100:00100000:3.0:1789480096.005330:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944320 00000100:00100000:3.0:1789480096.005374:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:3.0:1789480096.005384:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:11932:x1876405507944320:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480096.005403:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.005424:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2db0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480096.005446:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94c9e, atime: 0x6aa94c9c, ctime: 0x6aa94c9e, blocks: 0x8 00010000:00010000:3.0:1789480096.005469:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=464s v=(0 0) 00010000:00010000:3.0:1789480096.005474:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480096.005483:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.005713:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.005728:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd000, rc 0) 00000100:00100000:3.0:1789480096.005984:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:11932:x1876405507944320:12345-192.168.206.44@tcp:101:bash.0 Request processed in 600us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.005992:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:1.0:1789480096.007982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480096.009060:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944448 00000100:00100000:2.0:1789480096.009072:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944448 00002000:00010000:2.0:1789480096.009337:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789480096.009343:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a698892d180 with x1876405507944448 ext(0->18446744073709551615) 00002000:00010000:2.0:1789480096.009356:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a698892d180. 00000100:00100000:2.0:1789480096.009392:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1789480096.009402:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507944448:12345-192.168.206.44@tcp:10:bash.0 00002000:00010000:2.0:1789480096.009663:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789480096.009667:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789480094 -> 1789480095 00002000:00010000:2.0:1789480096.009670:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789480092 -> 1789480092 00002000:00010000:2.0:1789480096.009671:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789480094 -> 1789480095 00002000:00010000:2.0:1789480096.009674:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789480096.009741:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507944448:12345-192.168.206.44@tcp:10:bash.0 Request processed in 339us (1765us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789480096.009756:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00002000:00010000:2.0:1789480096.009760:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789480096.009763:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a698892d180 with x1876405507944448 ext(0->18446744073709551615) 00002000:00010000:2.0:1789480096.009767:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a698892d180. 00000100:00100000:2.0:1789480096.056039:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.056146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944576 00000100:00100000:1.0:1789480096.056157:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944576 00000100:00100000:1.0:1789480096.056351:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 209 00000100:00100000:1.0:1789480096.056363:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+35:12414:x1876405507944576:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:1.0:1789480096.056441:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056462:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056475:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056491:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056498:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056505:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056594:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056604:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056611:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789480096.056654:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056665:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056673:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056680:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056687:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.056691:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056700:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056712:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:1.0:1789480096.056715:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480096.056721:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056734:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e003 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056748:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056755:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056761:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056766:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.056769:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056775:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056782:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb5b2d00) 00010000:00010000:1.0:1789480096.056786:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480096.056789:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056794:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e00a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056807:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056813:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056825:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056830:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.056833:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056838:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056845:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:1.0:1789480096.056848:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480096.056851:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.056857:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e011 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.056950:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+35:12414:x1876405507944576:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 589us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.056959:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 209 00010000:00010000:3.0:1789480096.068856:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480096.105231:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.105709:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944832 00000100:00100000:0.0:1789480096.105720:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944832 00000100:00100000:0.0:1789480096.105787:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 210 00000100:00100000:0.0:1789480096.105799:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+35:12417:x1876405507944832:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480096.105826:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480096.105852:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2db7 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.105928:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.105946:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106462:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106484:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106491:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106499:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106601:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243e02d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106622:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243e02d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106629:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243e02d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480096.106640:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789480096.106768:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106778:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106787:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106793:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480096.106797:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106804:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106817:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480096.106820:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480096.106826:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106831:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e01f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106843:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106855:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106860:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106865:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480096.106867:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106873:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106880:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:0.0:1789480096.106883:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480096.106886:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106891:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e026 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.106932:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db7 expref: 38 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.107111:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243e02d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db7 expref: 37 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.107129:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480096.107132:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789480096.107140:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db400, rc 0) 00000100:00100000:0.0:1789480096.107297:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12417:x1876405507944832:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1489us (2102us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789480096.107306:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 210 00000100:00100000:2.0:1789480096.110349:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.110841:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507944960 00000100:00100000:3.0:1789480096.110851:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507944960 00000100:00100000:3.0:1789480096.110928:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:3.0:1789480096.110938:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12417:x1876405507944960:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1789480096.111012:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.111031:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.111041:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.111082:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.111097:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 37 pid: 6521 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.111111:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527934208:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480096.111328:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480096.115900:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.116038:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507945216 00000100:00100000:1.0:1789480096.116049:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507945216 00000100:00100000:1.0:1789480096.116124:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1789480096.116136:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+38:6180:x1876405507945216:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480096.116455:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+39:6180:x1876405507945216:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 321us (564us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789480096.116477:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:3.0:1789480096.119283:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527934208:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480096.119382:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.119569:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.119710:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507945344 00000100:00100000:0.0:1789480096.119718:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507945344 00010000:00010000:0.0:1789480096.119757:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 39 pid: 6521 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.119991:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 94 00000100:00100000:0.0:1789480096.120002:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+39:2401:x1876405507945344:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480096.120019:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480096.120027:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 39 pid: 6521 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120041:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 39 pid: 6521 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120064:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243dfd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d9b expref: 39 pid: 6521 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120078:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480096.120084:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120095:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120103:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.120155:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480096.120234:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+38:2401:x1876405507945344:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 233us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480096.120242:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 94 00010000:00010000:3.0:1789480096.121088:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121100:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121159:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121167:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121175:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121182:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.121186:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121213:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121226:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:3.0:1789480096.121229:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480096.121234:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.121241:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e03b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.121318:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12417:x1876405507944960:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 10379us (10975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.121326:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 211 00000100:00100000:1.0:1789480096.128049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480096.128168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507945600 00000100:00100000:2.0:1789480096.128179:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507945600 00000100:00100000:2.0:1789480096.128410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1789480096.128422:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+37:12417:x1876405507945600:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480096.128662:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+38:12417:x1876405507945600:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 242us (622us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789480096.128671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1789480096.260839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.263790:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507945856 00000100:00100000:1.0:1789480096.263806:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507945856 00000100:00100000:1.0:1789480096.263894:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:1.0:1789480096.263905:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+38:12428:x1876405507945856:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1789480096.263935:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480096.263970:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e042 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dbe expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264042:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264060:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264072:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264087:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264094:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264100:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.264275:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e057 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265291:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265312:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e057 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480096.265327:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789480096.265425:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265433:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265439:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265445:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.265449:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265457:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265470:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:1.0:1789480096.265473:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480096.265478:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265484:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e049 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265500:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265515:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265520:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265526:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.265529:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265534:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265542:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb5b2d00) 00010000:00010000:1.0:1789480096.265544:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480096.265547:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265552:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e050 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265602:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243e042 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dbe expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265615:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e057 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dbe expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.265622:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:1.0:1789480096.265624:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480096.265633:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc600, rc 0) 00000100:00100000:1.0:1789480096.265713:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12428:x1876405507945856:12345-192.168.206.44@tcp:101:cat.0 Request processed in 1808us (4882us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789480096.265722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 212 00000100:00100000:2.0:1789480096.284360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.284607:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507946112 00000100:00100000:0.0:1789480096.284618:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507946112 00000100:00100000:0.0:1789480096.284680:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1789480096.284691:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+40:12428:x1876405507946112:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:0.0:1789480096.285186:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+41:12428:x1876405507946112:12345-192.168.206.44@tcp:35:cat.0 Request processed in 495us (833us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789480096.285225:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:2.0:1789480096.307869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.307960:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507946368 00000100:00100000:0.0:1789480096.307970:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507946368 00000100:00100000:0.0:1789480096.308036:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 213 00000100:00100000:0.0:1789480096.308047:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+41:12429:x1876405507946368:12345-192.168.206.44@tcp:36:rm.0 00010000:00010000:0.0:1789480096.308110:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789480096.308152:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db600/0xdaa289fda243dff5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da9 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308175:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e057 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dbe expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308214:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db400/0xdaa289fda243e02d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db7 expref: 39 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308229:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243dfe7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2da2 expref: 38 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308255:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480096.308262:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480096.308286:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308312:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308323:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308337:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308344:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308350:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308434:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308443:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308449:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480096.308650:0:12158:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789480096.308660:0:12158:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 465232469570ns, next at 466232467010ns, rc = 0 00010000:00010000:0.0:1789480096.308717:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308725:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308732:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308739:0:12158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308745:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308751:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308782:0:12158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480096.308801:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308807:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308813:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308819:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480096.308823:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308831:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308846:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:0.0:1789480096.308849:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789480096.308853:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308859:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e073 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308874:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308880:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308885:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308890:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480096.308893:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308899:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308906:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480096.308908:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480096.308911:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308917:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e065 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480096.308939:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007327475b reply state 00000000ecb950fd transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308950:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.308956:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:0.0:1789480096.308957:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480096.308960:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480096.309038:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+39:12429:x1876405507946368:12345-192.168.206.44@tcp:36:rm.0 Request processed in 991us (1176us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789480096.309046:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 213 00010000:00010000:1.0:1789480096.309264:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480096.309271:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.309278:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480096.309281:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.309287:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.309308:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:1.0:1789480096.309310:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789480096.309313:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.309318:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e07a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.309330:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480096.309332:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480096.309333:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480096.362376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.362815:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507946624 00000100:00100000:3.0:1789480096.362826:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507946624 00000100:00100000:3.0:1789480096.362937:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:3.0:1789480096.362962:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+39:12435:x1876405507946624:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480096.362991:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.363015:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e081 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dc5 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363135:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363154:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363167:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363178:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363186:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363221:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480096.363509:0:8915:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789480096.363637:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363646:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363653:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363706:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363713:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363720:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363726:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.363731:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363739:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363751:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480096.363754:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.363759:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363765:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e088 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480096.363778:0:8915:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089ea860d reply state 00000000487d6e06 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363789:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363795:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480096.363804:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789480096.363807:0:8915:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789480096.363835:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e081 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 42 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363850:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 41 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.363857:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:3.0:1789480096.363859:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480096.363861:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecde00, rc 0) 00000100:00100000:3.0:1789480096.363932:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+42:12435:x1876405507946624:12345-192.168.206.44@tcp:101:bash.0 Request processed in 972us (1564us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789480096.363940:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 214 00000100:00100000:2.0:1789480096.368301:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.368751:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507946752 00000100:00100000:3.0:1789480096.368772:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507946752 00000100:00100000:3.0:1789480096.368844:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:3.0:1789480096.368855:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2401:x1876405507946752:12345-192.168.206.44@tcp:101:bash.0 00000100:00080000:2.0:1789480096.368999:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789480096.369032:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.369057:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dcc expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480096.369084:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480096.369106:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=465s v=(0 0) 00010000:00010000:3.0:1789480096.369123:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480096.369135:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.369171:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 8 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.369187:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd600, rc 0) 00000100:00100000:3.0:1789480096.369285:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507946752:12345-192.168.206.44@tcp:101:bash.0 Request processed in 431us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.369293:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789480096.374045:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.374147:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507946880 00000100:00100000:0.0:1789480096.374157:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507946880 00000100:00100000:0.0:1789480096.374238:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:0.0:1789480096.374249:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:12435:x1876405507946880:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480096.374268:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480096.374287:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dd3 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.374319:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 9 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.374340:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480096.374345:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480096.374350:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.374404:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 9 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.374420:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 9 pid: 8493 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.374435:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876405527934336:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480096.374740:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874743c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480096.379056:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.379387:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507947008 00000100:00100000:3.0:1789480096.379397:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507947008 00010000:00010000:3.0:1789480096.379439:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 10 pid: 8493 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.379536:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:3.0:1789480096.379546:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2401:x1876405507947008:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480096.379563:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480096.379585:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 10 pid: 8493 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.379600:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 10 pid: 8493 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.379631:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480096.379635:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480096.379645:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.379671:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.379720:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.379735:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876405527934464:192.168.206.44@tcp:105: 00000100:00100000:3.0:1789480096.379832:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9a80 going to sleep for 11 seconds 00010000:00010000:0.0:1789480096.382086:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002616b7ef/0xdaa289fda243e0a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dcc expref: 10 pid: 8493 timeout: 565 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.382111:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8434:1876405527934336:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480096.382156:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.382172:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:0.0:1789480096.382465:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:12435:x1876405507946880:12345-192.168.206.44@tcp:101:bash.0 Request processed in 8217us (8426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480096.382474:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1789480096.385932:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698792bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6506:1876405527934464:192.168.206.44@tcp:105: 00010000:00010000:3.0:1789480096.385959:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480096.386058:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507947008:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 6512us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.386069:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 95 00000100:00100000:2.0:1789480096.386079:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.386240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507947264 00000100:00100000:3.0:1789480096.386251:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507947264 00000100:00100000:3.0:1789480096.386291:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:3.0:1789480096.386299:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+42:12435:x1876405507947264:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1789480096.386676:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12435:x1876405507947264:12345-192.168.206.44@tcp:35:bash.0 Request processed in 375us (764us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789480096.386683:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1789480096.582283:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.585715:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507947392 00000100:00100000:1.0:1789480096.585731:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507947392 00000100:00100000:1.0:1789480096.585857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:1.0:1789480096.585869:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+43:12451:x1876405507947392:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480096.585930:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480096.585955:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e0b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dda expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586022:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586039:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586053:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480096.586093:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789480096.586097:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480096.586124:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586149:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e0b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dda expref: 45 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586168:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dda expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.586176:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:1.0:1789480096.586179:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480096.586183:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd000, rc 0) 00000100:00100000:1.0:1789480096.586291:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+44:12451:x1876405507947392:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 425us (4015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.586299:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 215 00000100:00100000:1.0:1789480096.598263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.598526:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507947648 00000100:00100000:3.0:1789480096.598538:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507947648 00000100:00100000:3.0:1789480096.598606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00100000:3.0:1789480096.598617:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95dfc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+44:12451:x1876405507947648:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480096.598655:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.598681:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2de1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.598791:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e0c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.598810:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.598823:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480096.598836:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789480096.599130:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de1 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.599150:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de1 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.599160:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:3.0:1789480096.599163:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480096.599167:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc200, rc 0) 00000100:00100000:3.0:1789480096.599377:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95dfc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+46:12451:x1876405507947648:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 762us (1123us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789480096.599384:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 216 00000100:00100000:3.0:1789480096.613295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.613338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.613419:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948032 00000100:00100000:1.0:1789480096.613430:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948032 00000100:00100000:1.0:1789480096.613502:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1789480096.613514:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+46:2399:x1876405507948032:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480096.613531:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480096.613559:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e0c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de1 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.613579:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:1.0:1789480096.613585:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480096.613643:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+45:2399:x1876405507948032:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.613650:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1789480096.613955:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507947904 00000100:00100000:2.0:1789480096.613961:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507947904 00000100:00100000:2.0:1789480096.613996:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00100000:2.0:1789480096.614006:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+45:12451:x1876405507947904:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480096.614039:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480096.614056:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e0d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2de8 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.614160:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.614177:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.614233:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480096.614247:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789480096.614349:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e0d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de8 expref: 48 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.614365:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de8 expref: 47 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.614373:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:2.0:1789480096.614388:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789480096.614392:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1000, rc 0) 00000100:00100000:2.0:1789480096.614430:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+47:12451:x1876405507947904:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 426us (1145us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789480096.614438:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 217 00000100:00100000:3.0:1789480096.620635:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.620803:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948160 00000100:00100000:1.0:1789480096.620814:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948160 00000100:00100000:1.0:1789480096.620875:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:1.0:1789480096.620885:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507948160:12345-192.168.206.44@tcp:1:lfs.0 00010000:00010000:1.0:1789480096.620938:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.620961:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.620970:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480096.620975:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480096.620980:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.621028:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.621043:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 8 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.621057:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527934592:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480096.621162:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480096.624654:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.624772:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1876405527934592:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480096.624802:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480096.625414:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948288 00000100:00100000:2.0:1789480096.625425:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948288 00002000:00100000:2.0:1789480096.625481:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a6988b38e00 x1876405507948288/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:247/0 lens 504/0 e 0 to 0 dl 1789480107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480096.625550:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6988b38e00 with x1876405507948288 ext(0->8) 00010000:00010000:2.0:1789480096.625561:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 9 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.625577:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 9 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480096.625585:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6988b38e00 00000100:00100000:2.0:1789480096.625701:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:2.0:1789480096.625712:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507948288:12345-192.168.206.44@tcp:4:lfs.0 00000100:00100000:2.0:1789480096.626885:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2402:x1876405507948288:12345-192.168.206.44@tcp:4:lfs.0 Request processed in 1169us (2234us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789480096.626897:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00002000:00100000:2.0:1789480096.626908:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a6988b38e00 x1876405507948288/t4294967309(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:247/0 lens 504/448 e 0 to 0 dl 1789480107 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480096.626918:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6988b38e00 with x1876405507948288 ext(0->8) 00010000:00010000:2.0:1789480096.626936:0:8442:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.626953:0:8442:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480096.626961:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a6988b38e00 00000100:00100000:2.0:1789480096.630263:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.630587:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948416 00000100:00100000:1.0:1789480096.630597:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948416 00010000:00010000:1.0:1789480096.630637:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.630684:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:1.0:1789480096.630694:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2402:x1876405507948416:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480096.630710:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789480096.630729:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789480096.630732:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789480096 00002000:00010000:1.0:1789480096.630734:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789480096 00002000:00010000:1.0:1789480096.630736:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789480096 00002000:00010000:1.0:1789480096.630739:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789480096.630745:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.630900:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.630926:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e0ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dd3 expref: 11 pid: 8434 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.630946:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480096.630951:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789480096.630957:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.630967:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.631041:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480096.631104:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2402:x1876405507948416:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 411us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.631122:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 96 00010000:00010000:3.0:1789480096.632676:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632692:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632721:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632730:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632738:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632745:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480096.632751:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632960:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.632999:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.633007:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce5447d9/0xdaa289fda243e0ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.633183:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507948160:12345-192.168.206.44@tcp:1:lfs.0 Request processed in 12295us (12552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.637473:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:2.0:1789480096.638088:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.638378:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948672 00000100:00100000:0.0:1789480096.638389:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948672 00000100:00100000:0.0:1789480096.638455:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1789480096.638466:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8633c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+47:12451:x1876405507948672:12345-192.168.206.44@tcp:35:lfs.0 00000004:00010000:0.0:1789480096.638866:0:14183:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de8 expref: 47 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480096.639177:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1789480096.639249:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1789480096.640145:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1789480096.640294:0:14183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.640383:0:14183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 51 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.640395:0:14183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.640437:0:14183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 51 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.640465:0:14183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 51 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.640481:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527934720:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480096.640970:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874743c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480096.646381:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.646472:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948800 00000100:00100000:1.0:1789480096.646483:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948800 00010000:00010000:1.0:1789480096.646541:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 52 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.646592:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:1.0:1789480096.646603:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+52:2401:x1876405507948800:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480096.646635:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480096.646644:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 52 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.646658:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 52 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.646682:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:1.0:1789480096.646687:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.646698:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.646707:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.646728:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480096.646783:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+52:2401:x1876405507948800:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 182us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.646790:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00010000:00010000:0.0:1789480096.648019:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e096 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dc5 expref: 51 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.648039:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:14183:1876405527934720:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480096.648065:0:14183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.648085:0:14183:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.648091:0:14183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789480096.648242:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1789480096.648346:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789480096.648440:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527934848:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789480096.649018:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480096.649101:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480096.650366:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527934848 00000100:00100000:3.0:1789480096.650379:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527934848 00000100:00100000:2.0:1789480096.651039:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789480096.651052:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527934848:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789480096.652261:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527934848:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 1208us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480096.652275:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789480096.652463:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527934848:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789480096.652650:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1789480096.652734:0:14183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527934976:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789480096.652786:0:14183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480096.652815:0:14183:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480096.653311:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527934976 00000100:00100000:2.0:1789480096.653320:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527934976 00000100:00100000:2.0:1789480096.653371:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789480096.653380:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14183:x1876405527934976:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1789480096.653529:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:14183:x1876405527934976:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 150us (742us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789480096.653537:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789480096.655006:0:14183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b3bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:14183:1876405527934976:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1789480096.655091:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789480096.655160:0:14183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655171:0:14183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655179:0:14183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655185:0:14183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480096.655232:0:14183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655242:0:14183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655260:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:1.0:1789480096.655263:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789480096.655269:0:14183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.655276:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e0f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14183 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789480096.655384:0:14183:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789480096.655442:0:14183:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789480096.655453:0:14183:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465579262119ns, next at 466579259942ns, rc = 0 00000001:00080000:1.0:1789480096.655459:0:14183:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1789480096.657650:0:14183:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6aa31c0f00) 00010000:00010000:1.0:1789480096.657660:0:14183:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789480096.657687:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e0dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2de8 expref: 55 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.658736:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8633c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:12451:x1876405507948672:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 20266us (20650us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1789480096.658749:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000020:00080000:1.0:1789480096.658756:0:14183:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789480096.662718:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.662859:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507948928 00000100:00100000:1.0:1789480096.662870:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507948928 00000100:00100000:1.0:1789480096.662948:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 218 00000100:00100000:1.0:1789480096.662959:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+54:12451:x1876405507948928:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480096.662986:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480096.663011:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243e0f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2def expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.663074:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243e0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2def expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.663090:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243e0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2def expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.663109:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:1.0:1789480096.663122:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480096.663126:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bd800, rc 0) 00000100:00100000:1.0:1789480096.663182:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+55:12451:x1876405507948928:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 225us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480096.663209:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 218 00000100:00080000:0.0:1789480096.664257:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480096.670012:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.670120:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507949184 00000100:00100000:3.0:1789480096.670131:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507949184 00000100:00100000:3.0:1789480096.670305:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480096.670317:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+55:12451:x1876405507949184:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480096.670619:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+56:12451:x1876405507949184:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 302us (613us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789480096.670628:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1789480096.788718:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.788800:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507949312 00000100:00100000:3.0:1789480096.788810:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507949312 00000100:00100000:3.0:1789480096.788867:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 219 00000100:00100000:3.0:1789480096.788885:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+56:12461:x1876405507949312:12345-192.168.206.44@tcp:34:lfs.0 00010000:00010000:3.0:1789480096.788963:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.788998:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789010:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789022:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789029:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789104:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789124:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789131:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789480096.789178:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789239:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789247:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789264:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789270:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecca00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.789274:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789282:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789295:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480096.789297:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.789303:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789309:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e0ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789323:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789328:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789334:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789339:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.789342:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789355:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789363:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480096.789365:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.789368:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789382:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789388:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789394:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789398:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecde00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.789400:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789406:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789412:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.789414:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.789417:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.789431:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e10d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.789509:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+56:12461:x1876405507949312:12345-192.168.206.44@tcp:34:lfs.0 Request processed in 632us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.789516:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 219 00000100:00100000:0.0:1789480096.846950:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.847034:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507949568 00000100:00100000:3.0:1789480096.847045:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507949568 00000100:00100000:3.0:1789480096.847107:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 220 00000100:00100000:3.0:1789480096.847127:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+56:12464:x1876405507949568:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480096.847151:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.847179:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e114 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2df6 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847281:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847297:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847310:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847321:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847342:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847366:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847466:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847474:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847481:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480096.847491:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789480096.847566:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847573:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847580:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847586:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.847590:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847599:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847611:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480096.847688:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.847702:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847709:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e11b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847724:0:12158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847730:0:12158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847735:0:12158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847741:0:12158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecca00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.847743:0:12158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847749:0:12158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847757:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480096.847759:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480096.847762:0:12158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847767:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e122 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847802:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e114 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847829:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 58 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.847835:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.847837:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480096.847839:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc200, rc 0) 00000100:00100000:3.0:1789480096.848002:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12464:x1876405507949568:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 877us (1062us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789480096.848010:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 220 00000100:00100000:1.0:1789480096.855660:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.855824:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507949696 00000100:00100000:3.0:1789480096.855835:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507949696 00000100:00100000:3.0:1789480096.855902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:3.0:1789480096.855914:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12464:x1876405507949696:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:3.0:1789480096.855988:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856009:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856023:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856056:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856063:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856080:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856087:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecde00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480096.856092:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856100:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856123:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.856126:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480096.856132:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.856138:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.856249:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12464:x1876405507949696:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 336us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.856256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 221 00000100:00100000:2.0:1789480096.859627:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480096.859813:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507949952 00000100:00100000:1.0:1789480096.859824:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507949952 00000100:00100000:1.0:1789480096.859890:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1789480096.859901:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+58:12464:x1876405507949952:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1789480096.860137:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12464:x1876405507949952:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 238us (529us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789480096.860145:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1789480096.955124:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480096.955300:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950208 00000100:00100000:2.0:1789480096.955326:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950208 00000100:00100000:2.0:1789480096.955429:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:2.0:1789480096.955442:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12474:x1876405507950208:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1789480096.955472:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480096.955476:0:8915:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789480096.955508:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd000/0xdaa289fda243e0b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dda expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955529:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480096.955535:0:8915:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480096.955551:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e13e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2dfd expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955666:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955682:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955691:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955738:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 59 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.955753:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 59 pid: 12158 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480096.955767:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935104:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480096.955907:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480096.959790:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480096.959971:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950336 00000100:00100000:0.0:1789480096.959980:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950336 00010000:00010000:0.0:1789480096.960016:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 60 pid: 12158 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480096.960060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 98 00000100:00100000:0.0:1789480096.960071:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+60:2401:x1876405507950336:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480096.960086:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480096.960093:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 60 pid: 12158 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.960106:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 60 pid: 12158 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.960139:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480096.960154:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.960164:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.960172:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480096.960218:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480096.960266:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+60:2401:x1876405507950336:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 197us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480096.960272:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 98 00010000:00010000:3.0:1789480096.962062:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e129 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2df6 expref: 59 pid: 12158 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.962085:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935104:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480096.962118:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.962128:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.962145:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480096.962165:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789480096.962355:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e13e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 60 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.962371:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 59 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.962381:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.962384:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480096.962388:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:3.0:1789480096.962491:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12474:x1876405507950208:12345-192.168.206.44@tcp:101:bash.0 Request processed in 7042us (7377us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789480096.962500:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 222 00000100:00100000:0.0:1789480096.964725:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480096.964747:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527935232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480096.964820:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480096.964893:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527935232 00000100:00100000:0.0:1789480096.964902:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527935232 00000100:00100000:0.0:1789480096.964957:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789480096.964967:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527935232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480096.964992:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480096.965037:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527935232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480096.965044:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789480096.965094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527935232:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789480096.965228:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480096.966139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527935360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480096.966183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480096.966376:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527935360 00000100:00100000:2.0:1789480096.966383:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527935360 00000100:00100000:2.0:1789480096.966423:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789480096.966431:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1876405527935360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480096.966459:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480096.966623:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3648:x1876405527935360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480096.966631:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789480096.967013:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527935360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480096.967090:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.967165:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950464 00000100:00100000:3.0:1789480096.967170:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950464 00000100:00100000:3.0:1789480096.967253:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:3.0:1789480096.967261:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+59:12474:x1876405507950464:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480096.967280:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.967302:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e04 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967337:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967371:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967383:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967552:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 61 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967570:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 60 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.967578:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.967581:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789480096.967586:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecca00, rc 0) 00000100:00100000:3.0:1789480096.967671:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+60:12474:x1876405507950464:12345-192.168.206.44@tcp:101:bash.0 Request processed in 410us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.967678:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 223 00000100:00100000:0.0:1789480096.973493:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.973761:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950720 00000100:00100000:3.0:1789480096.973773:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950720 00000100:00100000:1.0:1789480096.973945:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 224 00000100:00100000:1.0:1789480096.973958:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+60:12474:x1876405507950720:12345-192.168.206.44@tcp:36:bash.0 00010000:00010000:1.0:1789480096.974298:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.974399:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.974416:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480096.974463:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:1.0:1789480096.974488:0:6522:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001092fbf1 reply state 00000000faa6ce3c transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.974501:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480096.974510:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:1.0:1789480096.974523:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789480096.974529:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789480096.974725:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12474:x1876405507950720:12345-192.168.206.44@tcp:36:bash.0 Request processed in 769us (1239us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789480096.974733:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 224 00000020:00080000:1.0:1789480096.974738:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789480096.977665:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.977803:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950848 00000100:00100000:3.0:1789480096.977814:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950848 00000100:00100000:3.0:1789480096.977885:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 225 00000100:00100000:3.0:1789480096.977895:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12474:x1876405507950848:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:3.0:1789480096.977922:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480096.977944:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e168 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e0b expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.978050:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.978067:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 64 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.978077:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.978124:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 64 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.978138:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 64 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.978151:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935488:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480096.978261:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480096.981076:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935488:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480096.981106:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480096.983550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.983630:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507950976 00000100:00100000:3.0:1789480096.983640:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507950976 00010000:00010000:3.0:1789480096.983682:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 65 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480096.983733:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 99 00000100:00100000:3.0:1789480096.983756:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+65:2401:x1876405507950976:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480096.983772:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480096.983779:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 65 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983792:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 65 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983816:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e145 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2dfd expref: 65 pid: 8915 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983830:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480096.983834:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983845:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983853:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480096.983891:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480096.983947:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+64:2401:x1876405507950976:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 193us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480096.983956:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 99 00010000:00010000:2.0:1789480096.984325:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.984334:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480096.984384:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789480096.984389:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480096.984408:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.984438:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc200/0xdaa289fda243e168 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 64 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.984456:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 63 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480096.984464:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480096.984474:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480096.984491:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc000, rc 0) 00000100:00100000:2.0:1789480096.984534:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12474:x1876405507950848:12345-192.168.206.44@tcp:101:bash.0 Request processed in 6641us (7088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480096.984542:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 225 00000100:00100000:1.0:1789480096.992934:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480096.993063:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507951232 00000100:00100000:3.0:1789480096.993074:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507951232 00000100:00100000:3.0:1789480096.993136:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1789480096.993147:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+63:12474:x1876405507951232:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:3.0:1789480096.993626:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12474:x1876405507951232:12345-192.168.206.44@tcp:35:bash.0 Request processed in 479us (700us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789480096.993634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00010000:00010000:2.0:1789480097.092352:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480097.097970:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.098052:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507951360 00000100:00100000:3.0:1789480097.098062:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507951360 00000100:00100000:3.0:1789480097.098137:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:3.0:1789480097.098147:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+64:12480:x1876405507951360:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480097.098176:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.098227:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e12 expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098294:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098311:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098324:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480097.098363:0:12158:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789480097.098367:0:12158:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480097.098385:0:12158:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098410:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e12 expref: 66 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098428:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e12 expref: 65 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.098450:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480097.098453:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480097.098457:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd600, rc 0) 00000100:00100000:3.0:1789480097.098517:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507951360:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 372us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.098524:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 226 00000100:00100000:1.0:1789480097.102576:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.102655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507951488 00000100:00100000:3.0:1789480097.102665:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507951488 00000100:00100000:3.0:1789480097.102735:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00100000:3.0:1789480097.102746:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507951488:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480097.102779:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.102803:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e184 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e19 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102868:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102897:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102909:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102921:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102928:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.102952:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103020:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103028:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103036:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480097.103073:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789480097.103077:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480097.103093:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103103:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103122:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103129:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103136:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103142:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.103147:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103162:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103174:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480097.103176:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.103182:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103225:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e18b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103238:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103243:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103249:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103254:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.103257:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103263:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103270:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480097.103273:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.103275:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103291:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103319:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e184 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103332:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.103339:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.103341:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480097.103344:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecda00, rc 0) 00000100:00100000:3.0:1789480097.103404:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12480:x1876405507951488:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 659us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.103411:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 227 00000100:00100000:1.0:1789480097.108291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.108430:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507951744 00000100:00100000:2.0:1789480097.108441:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507951744 00000100:00100000:2.0:1789480097.108501:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 228 00000100:00100000:2.0:1789480097.108511:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12480:x1876405507951744:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480097.108534:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480097.108555:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e1a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e20 expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108657:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108674:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108683:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108692:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108734:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108763:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.108777:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935616:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480097.108885:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.108895:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.108903:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935744:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480097.108926:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480097.114074:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.114183:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507951872 00000100:00100000:0.0:1789480097.114229:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507951872 00010000:00010000:0.0:1789480097.114274:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 68 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.114309:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 100 00000100:00100000:0.0:1789480097.114320:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+68:2402:x1876405507951872:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480097.114337:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.114345:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 68 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.114358:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 68 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.114384:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480097.114390:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.114400:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.114407:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.114469:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+68:2402:x1876405507951872:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 150us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.114477:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 100 00010000:00010000:2.0:1789480097.116837:0:8915:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.44@tcp) returned -22 from blocking AST (req@00000000943f10ea x1876405527935616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.116862:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e199 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e19 expref: 67 pid: 6522 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.116891:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935616:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480097.118105:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527935744:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480097.118143:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480097.118149:0:8915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.118178:0:8915:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.118208:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.120168:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.120663:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952000 00000100:00100000:3.0:1789480097.120674:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952000 00010000:00010000:3.0:1789480097.120728:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.120780:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 101 00000100:00100000:3.0:1789480097.120790:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+67:2402:x1876405507952000:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480097.120807:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480097.120814:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120847:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120883:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e16f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e0b expref: 67 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120900:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.120906:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120918:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120926:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.120960:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480097.121017:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:2402:x1876405507952000:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 229us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.121026:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 101 00010000:00010000:2.0:1789480097.121440:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.121449:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480097.121469:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789480097.121600:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e1a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 67 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.121616:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 66 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.121623:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480097.121626:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480097.121629:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1a00, rc 0) 00000100:00100000:2.0:1789480097.121674:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12480:x1876405507951744:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 13164us (13390us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789480097.121681:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 228 00000100:00100000:2.0:1789480097.124458:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.124532:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952256 00000100:00100000:0.0:1789480097.124543:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952256 00000100:00100000:0.0:1789480097.124613:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789480097.124624:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12480:x1876405507952256:12345-192.168.206.44@tcp:103:lfs.0 00010000:00010000:0.0:1789480097.124654:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.124683:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd800/0xdaa289fda243e0f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2def expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.124701:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480097.124706:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.124889:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507952256:12345-192.168.206.44@tcp:103:lfs.0 Request processed in 266us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.124897:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1789480097.130181:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.130390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952384 00000100:00100000:0.0:1789480097.130400:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952384 00000100:00100000:0.0:1789480097.130503:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 229 00000100:00100000:0.0:1789480097.130515:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507952384:12345-192.168.206.44@tcp:58:lfs.0 00010000:00010000:0.0:1789480097.130623:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.130643:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.130657:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480097.130749:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789480097.131179:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507952384:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 664us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.131213:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 229 00000100:00100000:2.0:1789480097.133839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.134146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952512 00000100:00100000:3.0:1789480097.134157:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952512 00000100:00100000:3.0:1789480097.134232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 230 00000100:00100000:3.0:1789480097.134243:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+65:12480:x1876405507952512:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480097.134266:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.134290:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e27 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134357:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134368:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134388:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134400:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134414:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.134418:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480097.134422:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.134430:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc000, rc 0) 00000100:00100000:3.0:1789480097.134496:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12480:x1876405507952512:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 254us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.134503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 230 00000040:00080000:0.0:1789480097.350735:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480097.350743:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480097.350781:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789480097.350791:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480097.351468:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527935872:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480097.351572:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69878913c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480097.360546:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527935872:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480097.362435:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.362533:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952640 00000100:00100000:2.0:1789480097.362544:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952640 00000100:00100000:2.0:1789480097.362600:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 231 00000100:00100000:2.0:1789480097.362610:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12482:x1876405507952640:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480097.362644:0:8915:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480097.362746:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12482:x1876405507952640:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 137us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.362754:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 231 00000100:00100000:2.0:1789480097.369279:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.369365:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507952768 00000100:00100000:3.0:1789480097.369376:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507952768 00000100:00100000:3.0:1789480097.369442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00100000:3.0:1789480097.369452:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12482:x1876405507952768:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.369525:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369556:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369569:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369584:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369591:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369596:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369617:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369624:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369631:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480097.369672:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789480097.369677:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480097.369689:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369701:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369716:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369723:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369731:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecdc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.369735:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369743:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369757:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:3.0:1789480097.369760:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.369766:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369772:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e1c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369784:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369790:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369795:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369800:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.369808:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369815:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.369823:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8a6aa31c0900) 00010000:00010000:3.0:1789480097.370321:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.370327:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370335:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370352:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370357:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370363:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370367:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.370370:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370375:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370382:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.370384:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.370395:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.370401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.370485:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12482:x1876405507952768:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 1033us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.370493:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 232 00000100:00100000:1.0:1789480097.381525:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.381752:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507953024 00000100:00100000:0.0:1789480097.381764:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507953024 00000100:00100000:0.0:1789480097.381846:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:0.0:1789480097.381857:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+66:12482:x1876405507953024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480097.381880:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480097.381904:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e1d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e2e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382015:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382034:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382048:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480097.382060:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789480097.382147:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382155:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382162:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382180:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480097.382185:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382213:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382230:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480097.382234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789480097.382240:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382247:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e1df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382560:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e1d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e2e expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382573:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:0.0:1789480097.382575:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480097.382579:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e1d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e2e expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.382589:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dbe00, rc 0) 00000100:00100000:0.0:1789480097.382649:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953024:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 793us (1134us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1789480097.382656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 233 00000100:00100000:1.0:1789480097.386069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.386377:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507953152 00000100:00100000:3.0:1789480097.386390:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507953152 00000100:00100000:3.0:1789480097.386471:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:3.0:1789480097.386496:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953152:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789480097.386540:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789480097.386691:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953152:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 210us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.386699:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 234 00000100:00100000:1.0:1789480097.406254:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.406762:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507953408 00000100:00100000:3.0:1789480097.406774:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507953408 00000100:00100000:3.0:1789480097.406861:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:3.0:1789480097.406872:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.406904:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.406908:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789480097.406936:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e17d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e12 expref: 67 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.406959:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480097.406965:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789480097.406997:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e35 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480097.408167:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789480097.408671:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.408688:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.408700:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.408780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e1ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e35 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.409022:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e35 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.409034:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6aa31c0900) 00010000:00010000:3.0:1789480097.409037:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480097.409040:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd200, rc 0) 00000100:00100000:3.0:1789480097.409246:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12482:x1876405507953408:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2375us (3060us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789480097.409257:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 235 00000100:00100000:1.0:1789480097.412594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.412738:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507953664 00000100:00100000:0.0:1789480097.412768:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507953664 00000100:00100000:0.0:1789480097.412849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:0.0:1789480097.412862:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12482:x1876405507953664:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480097.413265:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.413296:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e1f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e35 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413413:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6aa31c0900) 00010000:00010000:0.0:1789480097.413428:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480097.413455:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413469:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413480:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413635:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413657:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.413670:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414360:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414372:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414393:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414399:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dbe00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480097.414403:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414411:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414425:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:0.0:1789480097.414428:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480097.414434:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbe00/0xdaa289fda243e202 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414456:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414462:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414467:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414472:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480097.414475:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414491:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414500:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xe9113128 (ffff8a6abb541100) 00010000:00010000:0.0:1789480097.414502:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480097.414506:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.414512:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e209 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xe9113128 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.414672:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953664:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 1808us (2086us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789480097.414683:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 236 00000100:00100000:1.0:1789480097.417591:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.417694:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507953792 00000100:00100000:2.0:1789480097.417706:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507953792 00000100:00100000:2.0:1789480097.417785:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:2.0:1789480097.417796:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+67:12482:x1876405507953792:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480097.417822:0:12158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480097.417866:0:12158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e210 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e3c expref: -99 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.417915:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.417931:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.417943:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.418051:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e210 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 69 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.418082:0:12158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 68 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.418091:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:2.0:1789480097.418094:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480097.418098:0:12158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0e00, rc 0) 00000100:00100000:2.0:1789480097.418174:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12482:x1876405507953792:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 379us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.418182:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 237 00000100:00100000:1.0:1789480097.426620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.427334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954048 00000100:00100000:3.0:1789480097.427346:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954048 00000100:00100000:3.0:1789480097.427445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 238 00000100:00100000:3.0:1789480097.427456:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+68:12482:x1876405507954048:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.427558:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.427578:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.427591:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480097.427740:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1789480097.427750:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 466351559333ns, next at 467351556732ns, rc = 0 00000004:00010000:3.0:1789480097.427799:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f05224f reply state 000000003ebefeb8 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.427812:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.427821:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:3.0:1789480097.427824:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789480097.427829:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789480097.427924:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12482:x1876405507954048:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 470us (1312us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789480097.427932:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 238 00000100:00100000:1.0:1789480097.431387:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.431448:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954176 00000100:00100000:0.0:1789480097.431460:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954176 00000100:00100000:0.0:1789480097.431521:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 239 00000100:00100000:0.0:1789480097.431531:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+70:12482:x1876405507954176:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480097.431559:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480097.431581:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e43 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.431748:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.431768:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 71 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.431807:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:0.0:1789480097.431811:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480097.431816:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dae00, rc 0) 00000100:00100000:0.0:1789480097.431877:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12482:x1876405507954176:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 348us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.431885:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 239 00000100:00100000:2.0:1789480097.439353:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.439432:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954304 00000100:00100000:3.0:1789480097.439443:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954304 00000100:00100000:3.0:1789480097.439534:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:3.0:1789480097.439546:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507954304:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789480097.440011:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480097.440182:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2402:x1876405507954304:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 637us (837us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789480097.440815:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:1.0:1789480097.443750:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.443844:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954560 00000100:00100000:0.0:1789480097.443857:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954560 00000100:00100000:0.0:1789480097.443927:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1789480097.443937:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+71:12482:x1876405507954560:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480097.444171:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+72:12482:x1876405507954560:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 235us (439us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1789480097.444180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1789480097.446963:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.447085:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954816 00000100:00100000:3.0:1789480097.447096:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954816 00000100:00100000:3.0:1789480097.447166:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 240 00000100:00100000:3.0:1789480097.447176:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+72:12482:x1876405507954816:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789480097.447318:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+72:12482:x1876405507954816:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 143us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.447326:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 240 00000100:00100000:2.0:1789480097.450880:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.451091:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507954944 00000100:00100000:3.0:1789480097.451102:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507954944 00000100:00100000:3.0:1789480097.451174:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:3.0:1789480097.451185:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+72:12482:x1876405507954944:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.451244:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.451269:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e22c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e4a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451345:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451375:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480097.451419:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480097.451440:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451481:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd600/0xdaa289fda243e22c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e4a expref: 74 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451500:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e4a expref: 73 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.451508:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:3.0:1789480097.451512:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789480097.451516:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecdc00, rc 0) 00000100:00100000:3.0:1789480097.451580:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+73:12482:x1876405507954944:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 396us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.451587:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 241 00000100:00100000:2.0:1789480097.456156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.456348:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955072 00000100:00100000:3.0:1789480097.456360:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955072 00000100:00100000:3.0:1789480097.456424:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:3.0:1789480097.456435:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+10:2401:x1876405507955072:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.456455:0:8493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480097.456491:0:8493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e51 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480097.456517:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94ca1, blocks: 0x0 00010000:00010000:3.0:1789480097.456539:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=466s v=(0 0) 00010000:00010000:3.0:1789480097.456544:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480097.456554:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 11 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.456592:0:8493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 11 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.456606:0:8493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecde00, rc 0) 00000100:00100000:3.0:1789480097.456665:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2401:x1876405507955072:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 232us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.456673:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:1.0:1789480097.464135:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.464371:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955328 00000100:00100000:0.0:1789480097.464381:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955328 00000100:00100000:0.0:1789480097.464436:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:0.0:1789480097.464446:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+73:12482:x1876405507955328:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789480097.464548:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+73:12482:x1876405507955328:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 103us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.464556:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 242 00000100:00100000:2.0:1789480097.468582:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.468702:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955456 00000100:00100000:0.0:1789480097.468713:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955456 00000100:00100000:0.0:1789480097.468770:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:0.0:1789480097.468781:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+11:12482:x1876405507955456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480097.468815:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480097.468850:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e58 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.468900:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 12 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.468973:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480097.468978:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480097.468985:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.469024:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 12 pid: 8493 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.469041:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 12 pid: 8493 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.469057:0:8434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527936000:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480097.469178:0:8434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480097.473862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.474046:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955584 00000100:00100000:3.0:1789480097.474057:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955584 00010000:00010000:3.0:1789480097.474100:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 13 pid: 8493 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.474159:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:3.0:1789480097.474170:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+13:2401:x1876405507955584:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480097.474218:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480097.474240:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 13 pid: 8493 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.474254:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 13 pid: 8493 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.474283:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480097.474287:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480097.474297:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.474322:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.474364:0:9525:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 13 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.474380:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9525:1876405527936128:192.168.206.44@tcp:105: 00000100:00100000:3.0:1789480097.474450:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9780 going to sleep for 11 seconds 00010000:00010000:0.0:1789480097.475154:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000078be1af/0xdaa289fda243e23a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e51 expref: 13 pid: 8493 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.475171:0:8434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8434:1876405527936000:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480097.475248:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.475271:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dbe00, rc 0) 00000100:00100000:0.0:1789480097.475308:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+12:12482:x1876405507955456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 6528us (6733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.475317:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:1.0:1789480097.477662:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480097.477686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527936256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480097.477749:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480097.478024:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527936256 00000100:00100000:3.0:1789480097.478034:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527936256 00000100:00100000:3.0:1789480097.478092:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789480097.478102:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527936256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480097.478147:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789480097.478233:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527936256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 132us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.478240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789480097.478710:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527936256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480097.484965:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.485140:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9525:1876405527936128:192.168.206.44@tcp:105: 00010000:00010000:3.0:1789480097.485166:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480097.485264:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2401:x1876405507955584:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 11095us (11410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.485275:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 102 00000100:00100000:2.0:1789480097.485444:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955712 00000100:00100000:2.0:1789480097.485453:0:8441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955712 00002000:00100000:2.0:1789480097.485500:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a6987d49180 x1876405507955712/t0(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:248/0 lens 504/0 e 0 to 0 dl 1789480108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480097.485511:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6987d49180 with x1876405507955712 ext(0->12) 00002000:00010000:2.0:1789480097.485517:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6987d49180 00000100:00100000:2.0:1789480097.485549:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1789480097.485559:0:8441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+11:2402:x1876405507955712:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789480097.487008:0:8441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+13:2402:x1876405507955712:12345-192.168.206.44@tcp:4:lhsmtool_posix.0 Request processed in 1443us (2044us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789480097.487115:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00002000:00100000:2.0:1789480097.487128:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a6987d49180 x1876405507955712/t4294967321(0) o4->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:248/0 lens 504/448 e 0 to 0 dl 1789480108 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480097.487137:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6987d49180 with x1876405507955712 ext(0->12) 00002000:00010000:2.0:1789480097.487143:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6987d49180 00000100:00100000:1.0:1789480097.491284:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.491798:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955840 00000100:00100000:3.0:1789480097.491810:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955840 00000100:00100000:3.0:1789480097.492089:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:3.0:1789480097.492101:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+73:12482:x1876405507955840:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789480097.494874:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1789480097.494892:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1789480097.494942:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789480097.494964:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6ab989c180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789480097.494969:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6986b6ca00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a6ab989c840 00000020:00080000:1.0:1789480097.494972:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a89a4e100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a698763ec00 00000004:00080000:1.0:1789480097.494995:0:6499:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789480097.495015:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a69874a9240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789480097.495018:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6abb7d7300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a69874a9840 00000020:00080000:1.0:1789480097.495021:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6abb7d7700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6988a8ce00 00000020:00080000:1.0:1789480097.495030:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789480097.495046:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789480097.495120:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789480097.495336:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480097.495357:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527936384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789480097.495419:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480097.495579:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12482:x1876405507955840:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 3479us (4303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.495589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 243 00000100:00100000:0.0:1789480097.495734:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527936384 00000100:00100000:0.0:1789480097.495743:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527936384 00000100:00100000:0.0:1789480097.495783:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789480097.495792:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3645:x1876405527936384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789480097.495818:0:8493:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:0.0:1789480097.495863:0:8493:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa94ca0, atime: 0x6aa94ca0, ctime: 0x6aa94ca0, blocks: 0x8 00010000:00010000:0.0:1789480097.495872:0:8493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.495889:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1789480097.495894:0:8493:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480097.495901:0:8493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.495921:0:8493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.495945:0:8493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.495953:0:8493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.495969:0:8493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789480097.496091:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3645:x1876405527936384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 300us (670us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789480097.496098:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:0.0:1789480097.496152:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6988823100/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789480097.496158:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527936384:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789480097.496186:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480097.496226:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.496235:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480097.496241:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.496252:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.496272:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.496292:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ad92922/0xdaa289fda243e248 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.496310:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480097.496312:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480097.496314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480097.497396:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527936512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789480097.497448:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480097.497491:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480097.497498:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527936640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789480097.497520:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480097.497635:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527936512 00000100:00100000:2.0:1789480097.497643:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527936512 00000100:00100000:2.0:1789480097.497692:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527936640 00000100:00100000:2.0:1789480097.497695:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527936640 00000100:00100000:2.0:1789480097.497715:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789480097.497725:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1876405527936512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789480097.497749:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1789480097.497770:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.497787:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.497797:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789480097.497801:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480097.497805:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.497845:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 12 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.497877:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 12 pid: 8435 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.497900:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527936768:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480097.498126:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480097.498142:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789480097.498150:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876405527936640:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789480097.498285:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789480097.498289:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789480097 00002000:00010000:2.0:1789480097.498291:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789480097.498293:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789480097 -> 1789480097 00002000:00010000:2.0:1789480097.498296:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789480097.498342:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3647:x1876405527936640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (821us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789480097.498349:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:2.0:1789480097.498389:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a69889f8380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789480097.498394:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527936640:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789480097.498690:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789480097.500606:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500624:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500632:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500639:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.500644:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500653:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500675:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a6aa31c0500) 00010000:00010000:3.0:1789480097.500678:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.500684:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500690:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243df46 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500723:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500730:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500735:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500754:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dba00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.500758:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500763:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500771:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a6987bf1700) 00010000:00010000:3.0:1789480097.500773:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.500776:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500782:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dba00/0xdaa289fda243dfee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500798:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500805:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500810:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500815:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.500818:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500824:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500855:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480097.500857:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.500861:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500871:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db200/0xdaa289fda243e06c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500885:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500891:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500896:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500901:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.500903:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500909:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500917:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6abb541000) 00010000:00010000:3.0:1789480097.500920:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.500923:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500928:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e08f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500953:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500960:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500966:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500971:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.500973:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500980:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500987:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.500990:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480097.500993:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.500999:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd200/0xdaa289fda243e161 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501009:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501016:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501022:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501036:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480097.501039:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501045:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501053:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:3.0:1789480097.501055:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480097.501058:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.501064:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e21e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.505731:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.505839:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507955968 00000100:00100000:2.0:1789480097.505851:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507955968 00000100:00100000:2.0:1789480097.505925:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:2.0:1789480097.505936:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+13:2402:x1876405507955968:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789480097.508782:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1789480097.508795:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:2.0:1789480097.509080:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507955968:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 3141us (3354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.509119:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:3.0:1789480097.511981:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1876405527936768:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480097.512014:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.515750:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480097.515820:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.516131:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956224 00000100:00100000:2.0:1789480097.516142:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956224 00000100:00100000:2.0:1789480097.516244:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:2.0:1789480097.516256:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12482:x1876405507956224:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480097.516316:0:12158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480097.516347:0:12158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e233 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e4a expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.516367:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:2.0:1789480097.516372:0:12158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480097.516405:0:12158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.516421:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.516431:0:12158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480097.516743:0:12158:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e46b7237 reply state 0000000029fe378b transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.516756:0:12158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.516773:0:12158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:2.0:1789480097.516776:0:12158:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480097.516787:0:12158:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480097.517045:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+22:12482:x1876405507956224:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 790us (1303us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789480097.517052:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 244 00000100:00100000:0.0:1789480097.517500:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956352 00000100:00100000:0.0:1789480097.517507:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956352 00010000:00010000:0.0:1789480097.517536:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.517566:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 103 00000100:00100000:0.0:1789480097.517575:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507956352:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480097.517588:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.517594:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.517607:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.517627:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243dffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2db0 expref: 8 pid: 8435 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.517641:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480097.517645:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480097.517659:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.517669:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.517701:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.517728:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507956352:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 154us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.517735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 103 00010000:00010000:3.0:1789480097.517810:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.517820:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.517841:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.517862:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.517897:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789480097.518046:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527936512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20321us (20596us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789480097.518053:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789480097.518095:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1789480097.518101:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:3.0:1789480097.518132:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a69889f8380, transno 4294967322 00000100:00100000:3.0:1789480097.518146:0:3647:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a69889f9500 x1876405527936512/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789480113 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789480097.518158:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a69889f9500/2, rc 0, transno 4294967323 00000100:00100000:3.0:1789480097.518164:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527936512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1789480097.518559:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480097.518567:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.518577:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480097.518582:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.518592:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.518608:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.518615:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e24f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.518645:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480097.518647:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480097.518648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480097.524396:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.524475:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956480 00000100:00100000:0.0:1789480097.524487:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956480 00000100:00100000:0.0:1789480097.524544:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1789480097.524554:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507956480:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789480097.524716:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789480097.524720:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789480097 -> 1789480096 00002000:00010000:0.0:1789480097.524722:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789480096 00002000:00010000:0.0:1789480097.524724:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789480097 -> 1789480096 00002000:00010000:0.0:1789480097.524726:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789480097.524790:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507956480:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 235us (401us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789480097.524798:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:1.0:1789480097.531142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.531624:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956736 00000100:00100000:3.0:1789480097.531636:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956736 00000100:00100000:3.0:1789480097.531734:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:3.0:1789480097.531746:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+22:12482:x1876405507956736:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789480097.531822:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.531855:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 22 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.531874:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.531927:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 22 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.531943:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 22 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.531957:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527936896:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480097.532032:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480097.534853:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527936896:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480097.534944:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.536376:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.539543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956864 00000100:00100000:0.0:1789480097.539560:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956864 00010000:00010000:0.0:1789480097.539725:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 23 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.539823:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 104 00000100:00100000:0.0:1789480097.539844:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+23:2402:x1876405507956864:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480097.539862:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.539869:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 23 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.539902:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 23 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.539925:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e217 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e3c expref: 23 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.539942:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:0.0:1789480097.539947:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.539958:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.539967:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.540007:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.540071:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2402:x1876405507956864:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 230us (3702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.540079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 104 00010000:00010000:2.0:1789480097.540148:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540156:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540221:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540228:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540235:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540241:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480097.540246:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540255:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540265:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:2.0:1789480097.540268:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789480097.540271:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.540277:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243e25d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.540324:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12482:x1876405507956736:12345-192.168.206.44@tcp:55:lhsmtool_posix.0 Request processed in 8581us (9191us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789480097.540332:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 245 00000100:00100000:1.0:1789480097.544256:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.544348:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507956992 00000100:00100000:2.0:1789480097.544360:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507956992 00000100:00100000:2.0:1789480097.544430:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:2.0:1789480097.544442:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507956992:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789480097.544506:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.544530:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.544539:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480097.544544:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789480097.544549:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.544590:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.544619:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 8 pid: 8434 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.544636:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527937024:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480097.544737:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480097.558605:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1876405527937024:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480097.558639:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.570584:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.571090:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957120 00000100:00100000:0.0:1789480097.571101:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957120 00010000:00010000:0.0:1789480097.571156:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 9 pid: 8434 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.571236:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 105 00000100:00100000:0.0:1789480097.571246:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507957120:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480097.571279:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.571302:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 9 pid: 8434 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.571317:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 9 pid: 8434 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.571342:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027e13812/0xdaa289fda243e241 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e58 expref: 9 pid: 8434 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.571360:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480097.571364:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789480097.571370:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.571381:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.571412:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.571528:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507957120:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 270us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.571537:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 105 00010000:00010000:1.0:1789480097.571790:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571801:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571822:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571832:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571841:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571849:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480097.571853:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571872:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571901:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.571909:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000346c4b1/0xdaa289fda243e264 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.572324:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507956992:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 27882us (28076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480097.572334:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:1.0:1789480097.579419:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.579773:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957376 00000100:00100000:0.0:1789480097.579786:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957376 00000100:00100000:0.0:1789480097.579915:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 246 00000100:00100000:0.0:1789480097.579926:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+21:12482:x1876405507957376:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789480097.580037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.580057:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 21 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.580066:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.580105:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 21 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.580132:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 21 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.580148:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937152:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480097.580839:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a829edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480097.593700:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937152:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480097.593733:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.597562:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.598135:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957504 00000100:00100000:3.0:1789480097.598147:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957504 00010000:00010000:3.0:1789480097.598213:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 22 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.598250:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 106 00000100:00100000:3.0:1789480097.598260:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2402:x1876405507957504:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480097.598279:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480097.598286:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 22 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598313:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 22 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598336:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e15a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e04 expref: 22 pid: 12158 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598354:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.598359:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598369:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598376:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598384:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.598420:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480097.598489:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:2402:x1876405507957504:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 230us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.598497:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 106 00010000:00010000:1.0:1789480097.599303:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599315:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599477:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599504:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599514:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599706:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.599730:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 21 pid: 6520 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.599745:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937280:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480097.599819:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a812edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480097.606290:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.606364:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957632 00000100:00100000:0.0:1789480097.606374:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957632 00010000:00010000:0.0:1789480097.606414:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 22 pid: 6520 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480097.606459:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 107 00000100:00100000:0.0:1789480097.606469:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2402:x1876405507957632:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480097.606485:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480097.606492:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 22 pid: 6520 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.606535:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 22 pid: 6520 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.606560:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:0.0:1789480097.606565:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.606575:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.606583:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480097.606606:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480097.606663:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2402:x1876405507957632:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 195us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.606670:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 107 00010000:00010000:3.0:1789480097.607835:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dae00/0xdaa289fda243e225 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e43 expref: 21 pid: 6520 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.607856:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937280:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480097.607900:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.607911:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.607917:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480097.608372:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789480097.608477:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1789480097.608505:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789480097.609035:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1876405527937408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789480097.609097:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480097.609179:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480097.613049:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527937408 00000100:00100000:2.0:1789480097.613065:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527937408 00000100:00100000:2.0:1789480097.614204:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789480097.614223:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a87833450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1876405527937408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789480097.614376:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a87833450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1876405527937408:12345-0@lo:1000:mdt00_002.0 Request processed in 160us (5278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.614385:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789480097.614584:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1876405527937408:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789480097.614740:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789480097.614818:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1876405527937536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789480097.614854:0:6522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480097.622990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.623030:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.623055:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958016 00000100:00100000:0.0:1789480097.623065:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958016 00000100:00100000:0.0:1789480097.623131:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 170 00000100:00100000:0.0:1789480097.623141:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507958016:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480097.623237:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+9:2402:x1876405507958016:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.623244:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 170 00000100:00100000:0.0:1789480097.623283:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.623377:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.623392:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958272 00000100:00100000:0.0:1789480097.623395:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958272 00000100:00100000:0.0:1789480097.623427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957888 00000100:00100000:0.0:1789480097.623429:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957888 00000100:00100000:0.0:1789480097.623444:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 359 00000100:00100000:0.0:1789480097.623450:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507958272:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480097.623485:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507958272:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 35us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.623492:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 359 00000100:00100000:0.0:1789480097.623503:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 360 00000100:00100000:0.0:1789480097.623509:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507957888:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480097.623737:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2402:x1876405507957888:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 227us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.623743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 360 00000100:00100000:0.0:1789480097.623779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.623795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958144 00000100:00100000:0.0:1789480097.623798:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958144 00000100:00100000:0.0:1789480097.623816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 361 00000100:00100000:0.0:1789480097.623821:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507958144:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480097.623846:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2402:x1876405507958144:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.623852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 361 00000100:00080000:0.0:1789480097.623919:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480097.623923:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480097.624166:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480097.625300:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527937536 00000100:00100000:3.0:1789480097.625311:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527937536 00000100:00100000:3.0:1789480097.625440:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507957760 00000100:00100000:3.0:1789480097.625445:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507957760 00000100:00100000:0.0:1789480097.625783:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789480097.625802:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1876405527937536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789480097.626165:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6522:x1876405527937536:12345-0@lo:1000:mdt00_002.0 Request processed in 364us (11309us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789480097.626173:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789480097.626224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 399 00000100:00100000:3.0:1789480097.626234:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507957760:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480097.626272:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6522:1876405527937536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789480097.626277:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2402:x1876405507957760:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 47us (3298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.626283:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 399 00010000:00010000:1.0:1789480097.626320:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626332:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626341:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626347:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bcc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480097.626353:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626361:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626386:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:1.0:1789480097.626389:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480097.626395:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626401:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bcc00/0xdaa289fda243e272 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626423:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626431:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626435:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626440:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480097.626442:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626448:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626454:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:1.0:1789480097.626457:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480097.626462:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626474:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626833:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.626874:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 24 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.626889:0:6522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937664:192.168.206.44@tcp:105: 00000100:00100000:1.0:1789480097.627262:0:6522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987474cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480097.633251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.633358:0:6522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6522:1876405527937664:192.168.206.44@tcp:105: 00010000:00010000:2.0:1789480097.633391:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633402:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dac00/0xdaa289fda243e1b5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633437:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633452:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633463:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633473:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633492:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633498:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633504:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480097.633508:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633526:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633540:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480097.633543:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480097.633547:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633553:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e279 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633563:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633568:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633574:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633578:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480097.633587:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633594:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633602:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480097.633604:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480097.633607:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.633612:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db000/0xdaa289fda243e26b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.633776:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+24:12482:x1876405507957376:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 53851us (54365us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789480097.633787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 246 00000020:00080000:2.0:1789480097.633793:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789480097.634410:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958400 00000100:00100000:3.0:1789480097.634421:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958400 00000100:00100000:3.0:1789480097.634473:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:3.0:1789480097.634484:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+24:12480:x1876405507958400:12345-192.168.206.44@tcp:49:lfs.0 00000100:00100000:3.0:1789480097.634591:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+24:12480:x1876405507958400:12345-192.168.206.44@tcp:49:lfs.0 Request processed in 108us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.634607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000040:00080000:0.0:1789480097.639699:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480097.639707:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480097.640385:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789480097.640395:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480097.640709:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.640749:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.641427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958912 00000100:00100000:0.0:1789480097.641438:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958912 00000100:00100000:2.0:1789480097.641598:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507958656 00000100:00100000:2.0:1789480097.641603:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507958656 00000100:00100000:2.0:1789480097.641649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:0.0:1789480097.641656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 247 00000100:00100000:2.0:1789480097.641660:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8633dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12482:x1876405507958656:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789480097.641662:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12480:x1876405507958912:12345-192.168.206.44@tcp:58:lfs.0 00000040:00080000:0.0:1789480097.641895:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789480097.642034:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+25:12480:x1876405507958912:12345-192.168.206.44@tcp:58:lfs.0 Request processed in 371us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480097.642042:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 247 00000004:00080000:2.0:1789480097.642347:0:6524:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789480097.642377:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1789480097.642408:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642424:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642434:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642455:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642461:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642466:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.642486:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480097.642544:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8633dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+26:12482:x1876405507958656:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 886us (1793us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1789480097.642551:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000020:00080000:2.0:1789480097.642555:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789480097.642709:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480097.642716:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.642726:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480097.642730:0:9524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.642739:0:9524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.642752:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:1.0:1789480097.642755:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789480097.642760:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.642766:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e280 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480097.642778:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480097.642788:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480097.642790:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480097.691025:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480097.691242:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959040 00000100:00100000:2.0:1789480097.691254:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959040 00000100:00100000:2.0:1789480097.691314:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 248 00000100:00100000:2.0:1789480097.691325:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+26:12484:x1876405507959040:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480097.691354:0:8915:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480097.691377:0:8915:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e287 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e5f expref: -99 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691446:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691462:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691476:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691519:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691527:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691534:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691611:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691623:0:8915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 27 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691631:0:8915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691667:0:8915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 27 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.691682:0:8915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 27 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480097.691696:0:8915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527937792:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480097.691809:0:8915:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480097.695526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480097.695642:0:8915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8915:1876405527937792:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480097.695673:0:8915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480097.695743:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959296 00000100:00100000:1.0:1789480097.695752:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959296 00000100:00100000:1.0:1789480097.695819:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1789480097.695829:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+28:6180:x1876405507959296:12345-192.168.206.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789480097.696340:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+29:6180:x1876405507959296:12345-192.168.206.44@tcp:35:ldlm_bl.0 Request processed in 509us (819us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789480097.696349:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1789480097.700186:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480097.700543:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959424 00000100:00100000:3.0:1789480097.700553:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959424 00010000:00010000:3.0:1789480097.700597:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 29 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480097.700638:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 108 00000100:00100000:3.0:1789480097.700649:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+29:2401:x1876405507959424:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480097.700664:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480097.700670:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 29 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700685:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 29 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700707:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1a00/0xdaa289fda243e1a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e20 expref: 29 pid: 8915 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700724:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480097.700728:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700739:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700773:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480097.700809:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480097.701026:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+28:2401:x1876405507959424:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 378us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480097.701034:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 108 00010000:00010000:2.0:1789480097.701268:0:8915:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701287:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480097.701335:0:8915:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789480097.701338:0:8915:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480097.701358:0:8915:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701370:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701380:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701386:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701393:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701400:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480097.701405:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701413:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701423:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:2.0:1789480097.701426:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480097.701430:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701450:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e28e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701462:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701468:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701474:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701490:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480097.701493:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701498:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701506:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a6987bf1b00) 00010000:00010000:2.0:1789480097.701509:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480097.701512:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701516:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e295 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701554:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0e00/0xdaa289fda243e287 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e5f expref: 28 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701569:0:8915:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e5f expref: 27 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480097.701582:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480097.701584:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789480097.701587:0:8915:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0a00, rc 0) 00000100:00100000:2.0:1789480097.701619:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12484:x1876405507959040:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 10296us (10602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480097.701626:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 248 00010000:00010000:0.0:1789480098.117820:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480098.351490:0:14719:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789480098.351498:0:14719:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789480098.351529:0:14719:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789480098.351536:0:14719:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789480098.512777:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1789480098.512796:0:8430:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:0.0:1789480098.692394:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789480098.692403:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480098.692426:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789480098.692435:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789480098.692574:0:13804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527937920:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789480098.692658:0:13804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789480098.702985:0:13804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1876405527937920:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480098.710150:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480098.710243:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959552 00000100:00100000:2.0:1789480098.710254:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959552 00000100:00100000:2.0:1789480098.710327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 249 00000100:00100000:2.0:1789480098.710338:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12496:x1876405507959552:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480098.710377:0:6522:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480098.710488:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12496:x1876405507959552:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 151us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480098.710496:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 249 00000100:00080000:0.0:1789480098.710595:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480098.716696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480098.717157:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959808 00000100:00100000:0.0:1789480098.717169:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959808 00000100:00100000:0.0:1789480098.717258:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00100000:0.0:1789480098.717269:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+27:12496:x1876405507959808:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480098.717292:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480098.717315:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243e2a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e66 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480098.717414:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243e2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480098.717430:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243e2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480098.717443:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243e2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480098.717452:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789480098.717808:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5dbc00/0xdaa289fda243e2a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e66 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480098.717830:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243e2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e66 expref: 29 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480098.717839:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480098.717842:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480098.717847:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da400, rc 0) 00000100:00100000:0.0:1789480098.717965:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+29:12496:x1876405507959808:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 697us (1275us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789480098.717973:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 250 00000100:00100000:0.0:1789480098.734157:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480098.734287:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507960192 00000100:00100000:2.0:1789480098.734297:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507960192 00000100:00100000:2.0:1789480098.734358:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 251 00000100:00100000:2.0:1789480098.734369:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+29:12496:x1876405507960192:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789480098.734458:0:8915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734477:0:8915:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734491:0:8915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734726:0:8915:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734734:0:8915:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734741:0:8915:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734747:0:8915:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480098.734752:0:8915:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734759:0:8915:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734773:0:8915:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480098.734776:0:8915:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480098.734781:0:8915:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480098.734787:0:8915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2b8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8915 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480098.735015:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+30:12496:x1876405507960192:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 647us (865us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789480098.735023:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 251 00000040:00080000:2.0:1789480098.737585:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480098.737594:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480098.738116:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789480098.738137:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789480098.743951:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480098.744037:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480098.744139:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507959936 00000100:00100000:0.0:1789480098.744150:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507959936 00000100:00100000:0.0:1789480098.744375:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789480098.744387:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+30:2402:x1876405507959936:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789480098.744405:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480098.744435:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da400/0xdaa289fda243e2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e66 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480098.744439:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507960448 00000100:00100000:2.0:1789480098.744446:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507960448 00000100:00100000:2.0:1789480098.744488:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1789480098.744496:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+31:12496:x1876405507960448:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00010000:00010000:0.0:1789480098.744617:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:0.0:1789480098.744623:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480098.744726:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+31:2402:x1876405507959936:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 340us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480098.744735:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1789480098.746746:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+30:12496:x1876405507960448:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 2240us (2698us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789480098.746760:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00010000:00010000:0.0:1789480099.140455:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480099.524366:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527938048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480099.524366:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527938176:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.525394:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527938304:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.528284:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532594:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532674:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527938688:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532731:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527939200:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532785:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532814:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527939712:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532839:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532859:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789480099.532866:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527938560:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532901:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532922:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527939072:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532941:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.532960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527939584:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.532981:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480099.533016:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938176 00000100:00100000:1.0:1789480099.533024:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938176 00000100:00100000:1.0:1789480099.533071:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789480099.533081:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527938176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.533149:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3646:x1876405527938176:12345-0@lo:400:kworker.0 Request processed in 70us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480099.533156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789480099.533209:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938048 00000100:00100000:1.0:1789480099.533214:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938048 00000100:00100000:1.0:1789480099.533242:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938688 00000100:00100000:1.0:1789480099.533245:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938688 00000100:00100000:1.0:1789480099.533261:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789480099.533267:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527938048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480099.533294:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480099.533881:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480099.533985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527938816:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.534015:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480099.534041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527939328:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.534061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480099.534084:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789480099.534091:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527938432:0@lo:400:kworker.0 00000100:00100000:0.0:1789480099.534158:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938560 00000100:00100000:0.0:1789480099.534164:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938560 00000100:00100000:0.0:1789480099.534212:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938304 00000100:00100000:0.0:1789480099.534215:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938304 00000100:00100000:0.0:1789480099.534226:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938816 00000100:00100000:0.0:1789480099.534229:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938816 00000100:00100000:0.0:1789480099.534247:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939328 00000100:00100000:0.0:1789480099.534249:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939328 00000100:00100000:0.0:1789480099.534263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789480099.534269:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527938560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480099.534456:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527938560:12345-0@lo:400:kworker.0 Request processed in 186us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480099.534463:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1789480099.534553:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789480099.534559:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527938304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480099.534590:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527938304:12345-0@lo:400:kworker.0 Request processed in 31us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480099.534597:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1789480099.534610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1789480099.534616:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527938816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.534632:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480099.535835:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939200 00000100:00100000:3.0:1789480099.535846:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939200 00000100:00100000:3.0:1789480099.535905:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939712 00000100:00100000:3.0:1789480099.535908:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939712 00000100:00100000:3.0:1789480099.535921:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939072 00000100:00100000:3.0:1789480099.535924:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939072 00000100:00100000:3.0:1789480099.535934:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939584 00000100:00100000:3.0:1789480099.535937:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939584 00000100:00100000:3.0:1789480099.535953:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789480099.535961:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527939200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.536019:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527939200:12345-0@lo:400:kworker.0 Request processed in 59us (3233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.536026:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789480099.536041:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789480099.536047:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527939712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.536091:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527939712:12345-0@lo:400:kworker.0 Request processed in 44us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.536106:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789480099.536119:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789480099.536125:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527939072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.536370:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527939072:12345-0@lo:400:kworker.0 Request processed in 245us (3427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.536376:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789480099.536564:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789480099.536571:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527939584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.536605:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527939584:12345-0@lo:400:kworker.0 Request processed in 35us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.536610:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789480099.537621:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938432 00000100:00100000:3.0:1789480099.537727:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938432 00000100:00100000:3.0:1789480099.537775:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789480099.537784:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527938688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.537851:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876405527938688:12345-0@lo:400:kworker.0 Request processed in 69us (5119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480099.539126:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527938048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5852us (10842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480099.539137:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789480099.539169:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789480099.539179:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527938432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.539238:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527938432:12345-0@lo:400:kworker.0 Request processed in 62us (4608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480099.539259:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789480099.539291:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789480099.541139:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789480099.541255:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527938048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480099.541628:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527938560:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.541981:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527939072:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.541996:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527939584:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.542025:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527938688:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.542034:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789480099.542039:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1789480099.542069:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6987d72d80, transno 4294967308 00000004:00080000:3.0:1789480099.542092:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1789480099.542112:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6988823100, transno 4294967311 00000100:00100000:3.0:1789480099.542118:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527939200:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.542134:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527939712:0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.542899:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527939328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480099.542989:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527939328:12345-0@lo:400:kworker.0 Request processed in 3690us (8926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480099.542998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00080000:1.0:1789480099.543059:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480099.543065:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480099.543068:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480099.543594:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527938176:0@lo:400:kworker.0 00000100:00100000:0.0:1789480099.544539:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527938816:12345-0@lo:400:kworker.0 Request processed in 9854us (10454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480099.544552:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1789480099.546807:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527938432:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.546823:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527938944:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.546877:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480099.549123:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527939456:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.549179:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480099.551048:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527938304:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.551069:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527938816:0@lo:400:kworker.0 00000100:00100000:2.0:1789480099.551095:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527939328:0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.551398:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527938944 00000100:00100000:3.0:1789480099.551407:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527938944 00000100:00100000:3.0:1789480099.551478:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939456 00000100:00100000:3.0:1789480099.551481:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939456 00000100:00100000:3.0:1789480099.551505:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789480099.551513:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527938944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.551587:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527938944:12345-0@lo:400:kworker.0 Request processed in 75us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.551593:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1789480099.551611:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789480099.551618:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527939456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480099.551646:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527939456:12345-0@lo:400:kworker.0 Request processed in 29us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480099.551651:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00080000:2.0:1789480099.551723:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789480099.551747:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6988b38700 x1876405527938944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480099.551831:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527938944:0@lo:400:kworker.0 00010000:00080000:2.0:1789480099.551846:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a698892f100 x1876405527939456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480115 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480099.551853:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527939456:0@lo:400:kworker.0 00000100:00100000:3.0:1789480100.036664:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480100.036688:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527939840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480100.036758:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480100.037223:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939840 00000100:00100000:0.0:1789480100.037232:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939840 00000100:00100000:0.0:1789480100.037282:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789480100.037292:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527939840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480100.037322:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789480100.037372:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527939840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480100.037379:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789480100.037429:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527939840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480100.037534:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480100.037543:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527939968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480100.037572:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480100.037604:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527939968 00000100:00100000:2.0:1789480100.037607:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527939968 00000100:00100000:2.0:1789480100.037632:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789480100.037638:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527939968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480100.037648:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789480100.038539:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527939968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 899us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480100.038547:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789480100.038589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527939968:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789480100.165048:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789480100.290273:0:14770:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480100.290283:0:14770:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480100.290314:0:14770:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789480100.290321:0:14770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789480100.512155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480100.515447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507960704 00000100:00100000:2.0:1789480100.515462:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507960704 00000100:00100000:3.0:1789480100.515725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00100000:3.0:1789480100.515735:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+30:12516:x1876405507960704:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480100.515763:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480100.515788:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e2bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e6d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.515894:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e2c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.515911:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.515923:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480100.515934:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789480100.516039:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd400/0xdaa289fda243e2bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e6d expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.516057:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e6d expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.516065:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480100.516068:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480100.516072:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecca00, rc 0) 00000100:00100000:3.0:1789480100.516154:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+32:12516:x1876405507960704:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 420us (4005us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789480100.516161:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 252 00000100:00080000:2.0:1789480100.516947:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480100.521025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480100.521117:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507960832 00000100:00100000:2.0:1789480100.521130:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507960832 00000100:00100000:2.0:1789480100.521225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:2.0:1789480100.521237:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+32:12516:x1876405507960832:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:2.0:1789480100.521309:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521330:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521344:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521379:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521387:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521395:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521401:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480100.521406:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521414:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521427:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:2.0:1789480100.521430:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480100.521435:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480100.521452:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1400/0xdaa289fda243e2d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480100.521515:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+32:12516:x1876405507960832:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 280us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480100.521523:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 253 00000100:00100000:2.0:1789480100.702510:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480100.702830:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507960960 00000100:00100000:3.0:1789480100.702842:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507960960 00000100:00100000:3.0:1789480100.702925:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:3.0:1789480100.702937:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2402:x1876405507960960:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:3.0:1789480100.702957:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480100.702990:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006152ffc5/0xdaa289fda243e2db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e74 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789480100.703023:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa94ca0, atime: 0x6aa94ca0, ctime: 0x6aa94ca0, blocks: 0x8 00010000:00010000:3.0:1789480100.703044:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=469s v=(0 0) 00010000:00010000:3.0:1789480100.703049:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480100.703060:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006152ffc5/0xdaa289fda243e2db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e74 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.703080:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006152ffc5/0xdaa289fda243e2db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e74 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480100.703105:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd400, rc 0) 00000100:00100000:3.0:1789480100.703173:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2402:x1876405507960960:12345-192.168.206.44@tcp:101:cat.0 Request processed in 238us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480100.703180:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00080000:2.0:1789480100.704127:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480100.710713:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480100.711775:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961088 00000100:00100000:2.0:1789480100.711788:0:8442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961088 00002000:00100000:2.0:1789480100.711849:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a6abb507100 x1876405507961088/t0(0) o3->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:251/0 lens 488/0 e 0 to 0 dl 1789480111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480100.711859:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb507100 with x1876405507961088 ext(0->4095) 00002000:00010000:2.0:1789480100.711866:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6abb507100 00000100:00100000:2.0:1789480100.711905:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480100.711915:0:8442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507961088:12345-192.168.206.44@tcp:3:cat.0 00000100:00100000:2.0:1789480100.712137:0:8442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2401:x1876405507961088:12345-192.168.206.44@tcp:3:cat.0 Request processed in 223us (1433us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789480100.712146:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00002000:00100000:2.0:1789480100.712153:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a6abb507100 x1876405507961088/t0(0) o3->f7386f76-6ebd-4087-bc50-a71a216590e4@192.168.206.44@tcp:251/0 lens 488/4536 e 0 to 0 dl 1789480111 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789480100.712161:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a6abb507100 with x1876405507961088 ext(0->4095) 00002000:00010000:2.0:1789480100.712164:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a6abb507100 00010000:00010000:0.0:1789480101.188535:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480102.085050:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527940096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480102.085134:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480102.085362:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940096 00000100:00100000:0.0:1789480102.085371:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940096 00000100:00100000:0.0:1789480102.085432:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480102.085442:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527940096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480102.085473:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480102.085521:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527940096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.085528:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789480102.085579:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527940096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789480102.087287:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480102.088340:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480102.088363:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527940224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480102.088422:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480102.088509:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940224 00000100:00100000:2.0:1789480102.088517:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940224 00000100:00100000:2.0:1789480102.088579:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789480102.088598:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527940224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789480102.088622:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789480102.088667:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527940224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480102.088681:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1789480102.088902:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480102.088942:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527940224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789480102.213357:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480102.597171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527940352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480102.597272:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480102.597806:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940352 00000100:00100000:0.0:1789480102.597817:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940352 00000100:00100000:0.0:1789480102.597870:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789480102.597882:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527940352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480102.597920:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789480102.597987:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527940352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.598068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789480102.598937:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527940352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480102.749243:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480102.749360:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480102.749361:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961216 00000100:00100000:3.0:1789480102.749372:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961216 00000100:00100000:0.0:1789480102.749392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480102.749423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 401 00000100:00100000:3.0:1789480102.749434:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507961216:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480102.749484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480102.749532:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507961216:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480102.749542:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 401 00000100:00100000:1.0:1789480102.749555:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961472 00000100:00100000:1.0:1789480102.749561:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961472 00000100:00100000:3.0:1789480102.749580:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961984 00000100:00100000:3.0:1789480102.749585:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961984 00000100:00100000:1.0:1789480102.749611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 368 00000100:00100000:3.0:1789480102.749625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 369 00000100:00100000:1.0:1789480102.749626:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507961472:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480102.749637:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507961984:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480102.750422:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961728 00000100:00100000:2.0:1789480102.750428:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961728 00000100:00100000:2.0:1789480102.750470:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:2.0:1789480102.750479:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2400:x1876405507961728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480102.756333:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480102.756498:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480102.756544:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00080000:0.0:1789480102.756566:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480102.756573:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480102.756590:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961344 00000100:00100000:0.0:1789480102.756600:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961344 00000100:00100000:0.0:1789480102.756648:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961856 00000100:00100000:0.0:1789480102.756652:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961856 00000100:00100000:0.0:1789480102.756670:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 370 00000100:00100000:0.0:1789480102.756680:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+32:2400:x1876405507961344:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480102.756764:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+32:2400:x1876405507961344:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 85us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.756771:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 370 00000100:00100000:0.0:1789480102.756789:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 371 00000100:00100000:0.0:1789480102.756796:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507961856:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480102.756821:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507961856:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.756826:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 371 00000100:00100000:0.0:1789480102.756847:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507961600 00000100:00100000:0.0:1789480102.756850:0:8436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507961600 00000100:00100000:0.0:1789480102.756877:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:0.0:1789480102.756883:0:8436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507961600:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480102.756908:0:8436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507961600:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480102.756914:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00080000:0.0:1789480102.756930:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480102.756932:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480102.758363:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507961472:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 8736us (9063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480102.758371:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507961984:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 8732us (8882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480102.758379:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 368 00000100:00100000:3.0:1789480102.758406:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 369 00000100:00100000:2.0:1789480102.761495:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+8:2400:x1876405507961728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 11004us (12089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480102.761511:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 175 00000001:00080000:0.0:1789480103.116399:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:1.0:1789480103.116427:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480103.116450:0:6499:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a6a812eda80 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:1.0:1789480103.116455:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480103.116458:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a9997e900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a6a812ed0c0 00000020:00080000:0.0:1789480103.116467:0:6499:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a6a9997e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a6988837400 00010000:00010000:1.0:1789480103.116471:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480103.116479:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480103.116485:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480103.116494:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1789480103.116495:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480103.116512:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:1.0:1789480103.116518:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a6987bf1200) 00010000:00010000:1.0:1789480103.116522:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480103.116527:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480103.116534:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1800/0xdaa289fda243e256 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12158 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789480103.116622:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1789480103.119327:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1789480103.119360:0:9515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1789480103.239000:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480104.260657:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480104.644368:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527940608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480104.644374:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527940736:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647094:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647188:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527940480:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647292:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527941120:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647317:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647339:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527941632:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647365:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647388:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789480104.647396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527940992:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647423:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647458:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527941504:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647482:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647528:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527940864:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647574:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527941376:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647617:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647635:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527941888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647680:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789480104.647686:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527941248:0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.647697:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941632 00000100:00100000:2.0:1789480104.647706:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941632 00000100:00100000:3.0:1789480104.647708:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480104.647725:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527941760:0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647743:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480104.647773:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941504 00000100:00100000:2.0:1789480104.647777:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941504 00000100:00100000:3.0:1789480104.647778:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940608 00000100:00100000:3.0:1789480104.647780:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940608 00000100:00100000:3.0:1789480104.647799:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941120 00000100:00100000:3.0:1789480104.647802:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941120 00000100:00100000:2.0:1789480104.647802:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789480104.647810:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940864 00000100:00100000:2.0:1789480104.647810:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527941632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.647811:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940864 00000100:00100000:3.0:1789480104.647824:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789480104.647866:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527941632:12345-0@lo:400:kworker.0 Request processed in 56us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.647883:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789480104.647902:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789480104.647908:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527941504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.647945:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527941504:12345-0@lo:400:kworker.0 Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.647951:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789480104.647967:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527940608:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480104.647969:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940992 00000100:00100000:2.0:1789480104.647972:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940992 00000100:00100000:2.0:1789480104.647991:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941376 00000100:00100000:2.0:1789480104.647993:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941376 00000004:00000024:3.0:1789480104.648000:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789480104.648005:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941888 00000100:00100000:2.0:1789480104.648007:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941888 00000100:00100000:2.0:1789480104.648018:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941248 00000100:00100000:2.0:1789480104.648021:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941248 00000100:00100000:3.0:1789480104.648037:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527940608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 207us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480104.648044:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789480104.648051:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527941760 00000100:00100000:2.0:1789480104.648054:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527941760 00000100:00100000:3.0:1789480104.648057:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789480104.648062:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527941120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.648067:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1789480104.648085:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527940992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.648101:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527941120:12345-0@lo:400:kworker.0 Request processed in 39us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.648113:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527940992:12345-0@lo:400:kworker.0 Request processed in 41us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480104.648117:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789480104.648118:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789480104.648130:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789480104.648130:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789480104.648135:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527940864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.648135:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527941376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.648167:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527940864:12345-0@lo:400:kworker.0 Request processed in 32us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480104.648173:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789480104.648217:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789480104.648224:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527941888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480104.649309:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1789480104.649328:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527941248:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789480104.652294:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480104.652304:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480104.652307:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480104.652366:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480104.654146:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698792b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527941376:12345-0@lo:400:kworker.0 Request processed in 3868us (4385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.654172:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789480104.654748:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527941888:12345-0@lo:400:kworker.0 Request processed in 6520us (7088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480104.654759:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1789480104.654806:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940736 00000100:00100000:3.0:1789480104.654818:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940736 00000100:00100000:2.0:1789480104.655337:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789480104.655367:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527941760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480104.655370:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789480104.655376:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527940736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.659798:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527942016:0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.660386:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527941760:12345-0@lo:400:kworker.0 Request processed in 5015us (12632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.660401:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789480104.660474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527940480 00000100:00100000:2.0:1789480104.660483:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527940480 00000100:00100000:2.0:1789480104.660548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789480104.660557:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527940480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.668633:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480104.668871:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480104.668885:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527942144:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.668929:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480104.669120:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942016 00000100:00100000:0.0:1789480104.669129:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942016 00000100:00100000:0.0:1789480104.669181:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942144 00000100:00100000:0.0:1789480104.669184:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942144 00000100:00100000:0.0:1789480104.669225:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789480104.669233:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527942016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.669365:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527942016:12345-0@lo:400:kworker.0 Request processed in 132us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480104.669373:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789480104.669403:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789480104.669409:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527942144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.669440:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527942144:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480104.669446:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1789480104.669535:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480104.669576:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1876405527941248:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.669590:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527941760:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.669601:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527940864:0@lo:400:kworker.0 00010000:00080000:0.0:1789480104.670051:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a79180 x1876405527941376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480104.670065:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527941376:0@lo:400:kworker.0 00010000:00080000:0.0:1789480104.670092:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1a7bb80 x1876405527941888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480120 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480104.670101:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527941888:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670154:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789480104.670160:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a69889f9500, transno 4294967323 00000004:00080000:0.0:1789480104.670176:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789480104.670212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527942144:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670226:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527942016:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670260:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527940992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670272:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527941504:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670375:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527941120:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670386:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527941632:0@lo:400:kworker.0 00000100:00100000:0.0:1789480104.670403:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987929f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527940608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480104.672999:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527940736:12345-0@lo:400:kworker.0 Request processed in 17609us (20621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480104.673016:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789480104.673988:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527940736:0@lo:400:kworker.0 00000100:00100000:2.0:1789480104.674668:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527940480:12345-0@lo:400:kworker.0 Request processed in 14107us (27411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480104.674682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789480104.675141:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876405527941248:12345-0@lo:400:kworker.0 Request processed in 25816us (27427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480104.675151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789480104.675446:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527940480:0@lo:400:kworker.0 00000100:00100000:0.0:1789480105.157722:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527942272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480105.157817:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480105.158025:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942272 00000100:00100000:3.0:1789480105.158036:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942272 00000100:00100000:3.0:1789480105.158105:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789480105.158117:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527942272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480105.158151:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789480105.158244:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527942272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480105.158272:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789480105.158331:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527942272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480105.160425:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527942400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480105.160508:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480105.160587:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942400 00000100:00100000:3.0:1789480105.160595:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942400 00000100:00100000:3.0:1789480105.160646:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789480105.160656:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527942400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480105.160679:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789480105.160726:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527942400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480105.160734:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789480105.160787:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527942400:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789480105.291385:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480105.560039:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480105.560225:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962112 00000100:00100000:3.0:1789480105.560237:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962112 00000100:00100000:3.0:1789480105.560322:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00100000:3.0:1789480105.560334:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:12169:x1876405507962112:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789480105.560451:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:12169:x1876405507962112:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 121us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480105.560459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 254 00000100:00080000:0.0:1789480105.563000:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480105.572758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480105.576050:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962240 00000100:00100000:2.0:1789480105.576080:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962240 00000100:00100000:2.0:1789480105.576326:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00100000:2.0:1789480105.576342:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:12169:x1876405507962240:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789480105.576498:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:12169:x1876405507962240:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 161us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480105.576507:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 255 00000100:00080000:0.0:1789480105.576579:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480105.586788:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480105.587149:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962496 00000100:00100000:3.0:1789480105.587162:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962496 00000100:00100000:3.0:1789480105.587314:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1789480105.587337:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+18:12169:x1876405507962496:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789480105.587673:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+19:12169:x1876405507962496:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 348us (898us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789480105.587681:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000040:00080000:0.0:1789480105.671338:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789480105.924547:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789480105.924557:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789480105.924582:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789480105.924592:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789480106.309042:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480107.204462:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527942528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480107.204545:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480107.204633:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942528 00000100:00100000:0.0:1789480107.204641:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942528 00000100:00100000:0.0:1789480107.204708:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789480107.204719:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527942528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480107.204755:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789480107.204805:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527942528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480107.204812:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1789480107.204836:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480107.204879:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527942528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480107.205075:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480107.205085:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527942656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480107.205123:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480107.205225:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942656 00000100:00100000:1.0:1789480107.205230:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942656 00000100:00100000:1.0:1789480107.205269:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789480107.205276:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527942656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789480107.205288:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480107.205322:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527942656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.205328:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:3.0:1789480107.205446:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480107.205469:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527942656:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789480107.338049:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480107.716615:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527942784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480107.716684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480107.718171:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942784 00000100:00100000:2.0:1789480107.718183:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942784 00000100:00100000:2.0:1789480107.718252:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789480107.718262:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527942784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480107.718306:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789480107.718378:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527942784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480107.718385:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789480107.718530:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a698892e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527942784:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1789480107.733252:0:14967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:48:25 (1789480105) 00000100:00100000:0.0:1789480107.867184:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480107.867262:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480107.867295:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962752 00000100:00100000:1.0:1789480107.867307:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962752 00000100:00100000:1.0:1789480107.867388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 378 00000100:00100000:0.0:1789480107.867402:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480107.867405:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:2400:x1876405507962752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480107.867436:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480107.867453:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480107.867469:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480107.868385:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:2400:x1876405507962752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 979us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.868397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 378 00000100:00100000:1.0:1789480107.868500:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963264 00000100:00100000:1.0:1789480107.868507:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963264 00000100:00100000:1.0:1789480107.868542:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962880 00000100:00100000:1.0:1789480107.868545:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962880 00000100:00100000:1.0:1789480107.868565:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:1.0:1789480107.868573:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507963264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480107.868605:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507963264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 33us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.868612:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 379 00000100:00100000:1.0:1789480107.868635:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 380 00000100:00100000:1.0:1789480107.868641:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507962880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480107.868668:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507962880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.868674:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 380 00000100:00080000:1.0:1789480107.868697:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480107.868702:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480107.871341:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507962624 00000100:00100000:1.0:1789480107.871361:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507962624 00000100:00100000:1.0:1789480107.871936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 403 00000100:00100000:1.0:1789480107.871955:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507962624:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480107.872037:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2400:x1876405507962624:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 90us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.872045:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 403 00000100:00100000:0.0:1789480107.872377:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480107.872408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963392 00000100:00100000:0.0:1789480107.872414:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963392 00000100:00100000:0.0:1789480107.872637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 381 00000100:00100000:0.0:1789480107.872946:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507963392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480107.873003:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507963392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 356us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480107.873011:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 381 00000100:00080000:0.0:1789480107.873042:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480107.876074:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963136 00000100:00100000:1.0:1789480107.876093:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963136 00000100:00100000:1.0:1789480107.876233:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00100000:1.0:1789480107.876247:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2400:x1876405507963136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480107.876347:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2400:x1876405507963136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 104us (8875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480107.876355:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 181 00000100:00080000:0.0:1789480107.876772:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480107.884280:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963008 00000100:00100000:2.0:1789480107.884304:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963008 00000100:00100000:2.0:1789480107.885906:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00100000:2.0:1789480107.885922:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a698892e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507963008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480107.886033:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a698892e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2400:x1876405507963008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 114us (18770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480107.886042:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 182 00000100:00080000:1.0:1789480107.888472:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789480108.364020:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789480109.254507:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1789480109.254523:0:6499:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789480109.254579:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789480109.254589:0:6552:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789480109.389001:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480109.767752:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527942912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480109.767880:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480109.767950:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527942912 00000100:00100000:0.0:1789480109.767959:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527942912 00000100:00100000:0.0:1789480109.768002:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789480109.768010:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527942912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480109.768059:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789480109.768107:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527942912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480109.768124:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789480109.768171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527942912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480109.769162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527943040:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769267:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527943552:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769311:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527944064:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769329:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789480109.769354:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527943168:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769373:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769389:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527943680:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769409:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769713:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527944192:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769739:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769771:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527943296:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769798:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769829:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527943808:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769853:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769869:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527944320:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769886:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769904:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789480109.769910:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527943424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769930:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.769940:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527943936:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.769957:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.770111:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527944448:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770134:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480109.770176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943552 00000100:00100000:1.0:1789480109.770185:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943552 00000100:00100000:1.0:1789480109.770252:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944064 00000100:00100000:1.0:1789480109.770255:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944064 00000100:00100000:1.0:1789480109.770269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943168 00000100:00100000:1.0:1789480109.770272:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943168 00000100:00100000:1.0:1789480109.770281:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943680 00000100:00100000:1.0:1789480109.770283:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943680 00000100:00100000:1.0:1789480109.770293:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944192 00000100:00100000:1.0:1789480109.770296:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944192 00000100:00100000:1.0:1789480109.770304:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943424 00000100:00100000:1.0:1789480109.770307:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943424 00000100:00100000:1.0:1789480109.770320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789480109.770328:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527943552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770378:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527943552:12345-0@lo:400:kworker.0 Request processed in 51us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770385:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789480109.770403:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789480109.770409:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527944064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770527:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527944064:12345-0@lo:400:kworker.0 Request processed in 117us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770533:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789480109.770545:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789480109.770550:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527943168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770574:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527943168:12345-0@lo:400:kworker.0 Request processed in 24us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789480109.770588:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789480109.770594:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527943680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770629:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527943680:12345-0@lo:400:kworker.0 Request processed in 36us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789480109.770646:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789480109.770651:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527944192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770673:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876405527944192:12345-0@lo:400:kworker.0 Request processed in 23us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770677:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789480109.770686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789480109.770691:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527943424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770719:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527943424:12345-0@lo:400:kworker.0 Request processed in 28us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770724:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789480109.770753:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943808 00000100:00100000:1.0:1789480109.770757:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943808 00000100:00100000:1.0:1789480109.770774:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944320 00000100:00100000:1.0:1789480109.770777:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944320 00000100:00100000:1.0:1789480109.770786:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943936 00000100:00100000:1.0:1789480109.770788:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943936 00000100:00100000:1.0:1789480109.770797:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944448 00000100:00100000:1.0:1789480109.770799:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944448 00000100:00100000:1.0:1789480109.770827:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789480109.770832:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527943808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770859:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527943808:12345-0@lo:400:kworker.0 Request processed in 27us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770864:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789480109.770873:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789480109.770884:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527944320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770912:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527944320:12345-0@lo:400:kworker.0 Request processed in 28us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480109.770918:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789480109.770928:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789480109.770933:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527943936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.770957:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527943936:12345-0@lo:400:kworker.0 Request processed in 24us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480109.771211:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943040 00000100:00100000:2.0:1789480109.771216:0:6512:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943040 00000100:00100000:2.0:1789480109.771247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789480109.771254:0:6512:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527943040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480109.771302:0:6512:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527943040:12345-0@lo:400:kworker.0 Request processed in 48us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480109.771308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1789480109.771338:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527943296 00000100:00100000:2.0:1789480109.771342:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527943296 00000100:00100000:2.0:1789480109.771364:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789480109.771370:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527943296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480109.771404:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527943296:12345-0@lo:400:kworker.0 Request processed in 33us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480109.771432:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789480109.771728:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:0.0:1789480109.771827:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480109.771833:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480109.771836:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480109.771838:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480109.772910:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789480109.772928:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527944448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.777627:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527943168:0@lo:400:kworker.0 00000100:00100000:2.0:1789480109.777640:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527944448:12345-0@lo:400:kworker.0 Request processed in 4715us (7501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480109.777653:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00010000:00080000:1.0:1789480109.777923:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888d5180 x1876405527943680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480109.777937:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527943680:0@lo:400:kworker.0 00010000:00080000:1.0:1789480109.777955:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888d5c00 x1876405527944192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480109.777963:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527944192:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.777972:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527943040:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.777982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527943552:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.777992:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527944064:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778040:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527943424:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778066:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527943936:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778091:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527944448:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778102:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527943296:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778112:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527943808:0@lo:400:kworker.0 00000100:00100000:1.0:1789480109.778122:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527944320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480110.276852:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527944704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480110.276933:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480110.277024:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944704 00000100:00100000:2.0:1789480110.277025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480110.277032:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527944576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480110.277033:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944704 00000100:00100000:2.0:1789480110.277065:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480110.277086:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944576 00000100:00100000:0.0:1789480110.277089:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944576 00000100:00100000:0.0:1789480110.277105:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789480110.277113:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527944704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480110.277124:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789480110.277131:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527944576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480110.277146:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00002000:00000024:0.0:1789480110.277146:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789480110.277280:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527944704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480110.277287:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789480110.281387:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527944576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4246us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.281404:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789480110.282035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527944576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480110.282152:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527944704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480110.340519:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480110.340609:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963520 00000100:00100000:2.0:1789480110.340619:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963520 00000100:00100000:2.0:1789480110.340696:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00100000:2.0:1789480110.340708:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:13187:x1876405507963520:12345-192.168.206.44@tcp:101:lsof.0 00010000:00010000:2.0:1789480110.340730:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480110.340754:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e7b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.340851:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.340866:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.340881:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480110.340926:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789480110.340929:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480110.340968:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.340993:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1000/0xdaa289fda243e2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e7b expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.341013:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e7b expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480110.341021:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:2.0:1789480110.341024:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480110.341028:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480110.341098:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:13187:x1876405507963520:12345-192.168.206.44@tcp:101:lsof.0 Request processed in 393us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480110.341105:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 256 00000100:00080000:0.0:1789480110.341738:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789480110.406663:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480111.430995:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480112.325028:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480112.325075:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527944832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480112.325151:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480112.326937:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480112.326960:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527944960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480112.327061:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480112.331345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480112.331430:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507963776 00000100:00100000:1.0:1789480112.331442:0:6524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507963776 00000100:00100000:1.0:1789480112.331516:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:1.0:1789480112.331527:0:6524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+18:13190:x1876405507963776:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:1.0:1789480112.331846:0:6524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+19:13190:x1876405507963776:12345-192.168.206.44@tcp:35:umount.0 Request processed in 320us (508us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789480112.331854:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00080000:0.0:1789480112.332235:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480112.333786:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944832 00000100:00100000:3.0:1789480112.333799:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944832 00000100:00100000:3.0:1789480112.333868:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527944960 00000100:00100000:3.0:1789480112.333872:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527944960 00000100:00100000:3.0:1789480112.333893:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789480112.333902:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527944832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480112.333935:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480112.334009:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527944832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (8857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480112.334016:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789480112.334044:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789480112.334052:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527944960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480112.334062:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480112.334090:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527944960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (7030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480112.334111:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789480112.334231:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527944832:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789480112.334312:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480112.334775:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527944960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480112.338321:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480112.338716:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964032 00000100:00100000:0.0:1789480112.338727:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964032 00000100:00100000:0.0:1789480112.338837:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:0.0:1789480112.338849:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+19:13190:x1876405507964032:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:0.0:1789480112.339214:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+20:13190:x1876405507964032:12345-192.168.206.44@tcp:35:umount.0 Request processed in 345us (879us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789480112.339223:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:1.0:1789480112.346281:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480112.346362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964288 00000100:00100000:3.0:1789480112.346374:0:6523:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964288 00000100:00100000:3.0:1789480112.346430:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1789480112.346440:0:6523:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8633c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+20:13190:x1876405507964288:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:3.0:1789480112.346665:0:6523:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8633c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+21:13190:x1876405507964288:12345-192.168.206.44@tcp:35:umount.0 Request processed in 226us (392us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789480112.346673:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00100000:3.0:1789480112.350159:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480112.350313:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964544 00000100:00100000:0.0:1789480112.350325:0:14183:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964544 00000100:00100000:0.0:1789480112.350382:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:0.0:1789480112.350393:0:14183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+21:13190:x1876405507964544:12345-192.168.206.44@tcp:35:umount.0 00000100:00100000:0.0:1789480112.350750:0:14183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69889fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f7386f76-6ebd-4087-bc50-a71a216590e4+22:13190:x1876405507964544:12345-192.168.206.44@tcp:35:umount.0 Request processed in 357us (652us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789480112.350758:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:2.0:1789480112.359104:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480112.359146:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480112.359297:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964672 00000100:00100000:1.0:1789480112.359308:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964672 00000100:00100000:1.0:1789480112.359375:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964800 00000100:00100000:1.0:1789480112.359378:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964800 00000100:00100000:1.0:1789480112.359582:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1789480112.359594:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+14:2401:x1876405507964672:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480112.359612:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480112.359647:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bd400/0xdaa289fda243d2ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29d5 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480112.359664:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480112.359721:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+13:2401:x1876405507964672:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 130us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.359729:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1789480112.359748:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1789480112.359754:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2401:x1876405507964800:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480112.359778:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480112.359787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243d211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2996 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480112.359805:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480112.359824:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:2401:x1876405507964800:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 70us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480112.359830:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1789480112.362547:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480112.362628:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507964928 00000100:00100000:2.0:1789480112.362638:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507964928 00000100:00100000:2.0:1789480112.362704:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1789480112.362715:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:2399:x1876405507964928:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480112.362732:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480112.362752:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0800/0xdaa289fda243d4e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aae expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.362780:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480112.362847:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2399:x1876405507964928:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480112.362854:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1789480112.370184:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480112.370620:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507965312 00000100:00100000:3.0:1789480112.370631:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507965312 00000100:00100000:3.0:1789480112.370705:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:3.0:1789480112.370716:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+7:2398:x1876405507965312:12345-192.168.206.44@tcp:9:umount.0 00000020:00000080:3.0:1789480112.370748:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d85b 00000020:00010000:3.0:1789480112.370755:0:8434:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a6a8611a000: total 0 00000100:00080000:3.0:1789480112.370760:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a6a8611b000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1789480112.370922:0:9524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a6a8611a000: total 0 00010000:00010000:2.0:1789480112.370973:0:9524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a6a8611a000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789480112.371046:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243dc1a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c98 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.371082:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006152ffc5/0xdaa289fda243e2db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e74 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480112.371097:0:9524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a6a8611a000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789480112.371110:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.371125:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480112.371127:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480112.371546:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:3.0:1789480112.371628:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789480112.371850:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f7386f76-6ebd-4087-bc50-a71a216590e4+2:2398:x1876405507965312:12345-192.168.206.44@tcp:9:umount.0 Request processed in 1133us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480112.371860:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 80 00000100:00100000:1.0:1789480112.383581:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480112.385974:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507965440 00000100:00100000:2.0:1789480112.385991:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507965440 00000100:00100000:2.0:1789480112.386124:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 81 00000100:00100000:2.0:1789480112.386135:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2398:x1876405507965440:12345-192.168.206.44@tcp:9:umount.0 00000020:00000080:2.0:1789480112.386175:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d5ec 00000100:00080000:2.0:1789480112.386183:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6ac1b32800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789480112.386247:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789480112.386497:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f7386f76-6ebd-4087-bc50-a71a216590e4+2:2398:x1876405507965440:12345-192.168.206.44@tcp:9:umount.0 Request processed in 363us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480112.386506:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 81 00010000:00010000:3.0:1789480112.386753:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480112.387504:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480112.394364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480112.394509:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507966464 00000100:00100000:0.0:1789480112.394520:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507966464 00000100:00100000:0.0:1789480112.394580:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 257 00000100:00100000:0.0:1789480112.394590:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+22:2398:x1876405507966464:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:0.0:1789480112.394629:0:8915:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d21f 00000020:00010000:0.0:1789480112.394644:0:8915:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a6987e10800: total 0 00000100:00080000:0.0:1789480112.394650:0:8915:0:(import.c:65:import_set_state_nolock()) ffff8a6987e12000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789480112.394679:0:8915:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789480112.394859:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f7386f76-6ebd-4087-bc50-a71a216590e4+21:2398:x1876405507966464:12345-192.168.206.44@tcp:39:umount.0 Request processed in 269us (503us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789480112.394867:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 257 00000020:00010000:3.0:1789480112.395094:0:6508:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a6987e10800: total 0 00010000:00010000:3.0:1789480112.395147:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a6987e10800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789480112.395250:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6a97c2e200) 00010000:00010000:3.0:1789480112.395253:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480112.395264:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6400/0xdaa289fda243d54b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2abc expref: 20 pid: 12158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395287:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480112.395289:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480112.395294:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243e1bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e27 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395306:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480112.395308:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480112.395312:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243dafb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c4b expref: 18 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395325:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480112.395328:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480112.395331:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da600/0xdaa289fda243dc91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cb4 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395345:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480112.395348:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789480112.395351:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c6a00/0xdaa289fda243d5c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ad8 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395362:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480112.395364:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480112.395367:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecca00/0xdaa289fda243e2c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e6d expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395393:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480112.395395:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789480112.395398:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047bc00/0xdaa289fda243dc05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c91 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395423:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a6aa31c0300) 00010000:00010000:3.0:1789480112.395425:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480112.395429:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243d8bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2bb1 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395443:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a6abb5b2d00) 00010000:00010000:3.0:1789480112.395445:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480112.395448:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243e29c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e5f expref: 12 pid: 8915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395463:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a97c2ea00) 00010000:00010000:3.0:1789480112.395465:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480112.395469:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6aa33c7000/0xdaa289fda243d567 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ac3 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395482:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a6a8be16100) 00010000:00010000:3.0:1789480112.395484:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480112.395487:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5db800/0xdaa289fda243dbdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2c83 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395500:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a6aa31c0400) 00010000:00010000:3.0:1789480112.395503:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789480112.395513:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987eccc00/0xdaa289fda243df7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2d8d expref: 9 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395528:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:3.0:1789480112.395531:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480112.395534:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a400/0xdaa289fda243dc75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2cad expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480112.395545:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a6987e10800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789480112.395560:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480112.395562:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480112.395564:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480112.407580:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480112.407673:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507966592 00000100:00100000:1.0:1789480112.407683:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507966592 00000100:00100000:1.0:1789480112.407760:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 258 00000100:00100000:1.0:1789480112.407782:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+5:2398:x1876405507966592:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:1.0:1789480112.407829:0:12158:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d226 00000100:00080000:1.0:1789480112.407859:0:12158:0:(import.c:65:import_set_state_nolock()) ffff8a6987e16000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789480112.407954:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:1.0:1789480112.408170:0:12158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789480112.408363:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f7386f76-6ebd-4087-bc50-a71a216590e4+3:2398:x1876405507966592:12345-192.168.206.44@tcp:39:umount.0 Request processed in 583us (792us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789480112.408372:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 258 00010000:00010000:3.0:1789480112.410704:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480112.455736:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480112.836716:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480112.836745:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527945088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480112.836825:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480112.837083:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945088 00000100:00100000:3.0:1789480112.837092:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945088 00000100:00100000:3.0:1789480112.837149:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789480112.837170:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527945088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480112.837235:0:7836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789480112.837282:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527945088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480112.837289:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789480112.837430:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527945088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480112.981479:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480112.981523:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480112.981615:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507966848 00000100:00100000:0.0:1789480112.981626:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507966848 00000100:00100000:0.0:1789480112.981706:0:8915:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507966720 00000100:00100000:0.0:1789480112.981710:0:8915:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507966720 00000100:00100000:0.0:1789480112.981748:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 388 00000100:00100000:0.0:1789480112.981758:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507966848:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480112.981835:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+5:2400:x1876405507966848:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 78us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480112.981842:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 388 00000100:00100000:0.0:1789480112.981860:0:8915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 389 00000100:00100000:0.0:1789480112.981866:0:8915:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2400:x1876405507966720:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480112.981902:0:8915:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:71ef009f-7b67-4186-8594-2437af8601ad+6:2400:x1876405507966720:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480112.981909:0:8915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 389 00000100:00080000:2.0:1789480112.982085:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480112.982090:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789480113.476702:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480114.372389:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480114.372426:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480114.372462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480114.372546:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507966976 00000100:00100000:1.0:1789480114.372557:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507966976 00000100:00100000:1.0:1789480114.372622:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507967232 00000100:00100000:1.0:1789480114.372625:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507967232 00000100:00100000:1.0:1789480114.372639:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507967104 00000100:00100000:1.0:1789480114.372642:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507967104 00000100:00100000:1.0:1789480114.372659:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789480114.372668:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+12:2401:x1876405507966976:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480114.372684:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480114.372716:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bc400/0xdaa289fda243d322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29ea expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.372734:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480114.372780:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+11:2401:x1876405507966976:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480114.372789:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789480114.372806:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1789480114.372812:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a9f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+10:2401:x1876405507967232:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480114.372820:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480114.372829:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0000/0xdaa289fda243d4e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2aa7 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.372838:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480114.372869:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a9f5bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+9:2401:x1876405507967232:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480114.372876:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1789480114.372912:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1789480114.372918:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+8:2401:x1876405507967104:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480114.372925:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480114.372934:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7600/0xdaa289fda243d329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2a1b expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.372943:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480114.372960:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+7:2401:x1876405507967104:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 41us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480114.372965:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1789480114.392418:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480114.392521:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507967488 00000100:00100000:1.0:1789480114.392532:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507967488 00000100:00100000:1.0:1789480114.392611:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 259 00000100:00100000:1.0:1789480114.392622:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+6:2398:x1876405507967488:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:1.0:1789480114.392666:0:6520:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d337 00000020:00010000:1.0:1789480114.392674:0:6520:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a6987e51000: total 0 00000100:00080000:1.0:1789480114.392679:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8a6987e55800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480114.392717:0:6520:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1789480114.392895:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:71ef009f-7b67-4186-8594-2437af8601ad+5:2398:x1876405507967488:12345-192.168.206.44@tcp:39:umount.0 Request processed in 274us (486us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1789480114.392904:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 259 00000100:00080000:2.0:1789480114.393107:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789480114.393488:0:9524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a6987e51000: total 0 00010000:00010000:3.0:1789480114.393493:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480114.393546:0:9524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a6987e51000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789480114.393587:0:9524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf1a00) 00010000:00010000:3.0:1789480114.393591:0:9524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480114.393602:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0200/0xdaa289fda243e2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e7b expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480114.393639:0:9524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a6987e51000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789480114.393653:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480114.393655:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480114.393656:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480114.408319:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480114.408451:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507967616 00000100:00100000:1.0:1789480114.408464:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507967616 00000100:00100000:1.0:1789480114.408557:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 260 00000100:00100000:1.0:1789480114.408589:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+5:2398:x1876405507967616:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:1.0:1789480114.408648:0:6522:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d33e 00000100:00080000:1.0:1789480114.408659:0:6522:0:(import.c:65:import_set_state_nolock()) ffff8a6987e50000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789480114.408700:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789480114.408895:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:71ef009f-7b67-4186-8594-2437af8601ad+3:2398:x1876405507967616:12345-192.168.206.44@tcp:39:umount.0 Request processed in 309us (588us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789480114.408904:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 260 00010000:00010000:0.0:1789480114.409040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789480114.409457:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480114.446291:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480114.446415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507967872 00000100:00100000:3.0:1789480114.446427:0:6514:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507967872 00000100:00100000:3.0:1789480114.446493:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 405 00000100:00100000:3.0:1789480114.446505:0:6514:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+7:2398:x1876405507967872:12345-192.168.206.44@tcp:251:umount.0 00000020:00000080:3.0:1789480114.446554:0:6514:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d1fc 00000020:00010000:3.0:1789480114.446564:0:6514:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a6987e56000: total 0 00000100:00080000:3.0:1789480114.446569:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8a6987e52800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789480114.446650:0:6514:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9d3d8ec2-b7ed-481f-86df-876452d4dcf6+3:2398:x1876405507967872:12345-192.168.206.44@tcp:251:umount.0 Request processed in 148us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.446659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 405 00000020:00010000:1.0:1789480114.446983:0:6508:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a6987e56000: total 0 00010000:00010000:1.0:1789480114.447062:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a6987e56000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789480114.447100:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bde00/0xdaa289fda243d2d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d29dc expref: 2 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480114.447116:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a6987e56000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789480114.447126:0:6508:0:(genops.c:885:class_export_put()) final put ffff8a6987e56000/9d3d8ec2-b7ed-481f-86df-876452d4dcf6 00010000:00010000:1.0:1789480114.447146:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480114.447149:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480114.447151:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789480114.447329:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e56000/9d3d8ec2-b7ed-481f-86df-876452d4dcf6 for MGS 00000020:00000080:3.0:1789480114.447476:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e52800 for MGS 00010000:00010000:3.0:1789480114.500880:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480114.885526:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527945600:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885619:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885678:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527946112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885705:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885730:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527946624:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885751:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885788:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789480114.885796:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527945216:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885841:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885864:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527945728:0@lo:400:kworker.0 00000100:00100000:0.0:1789480114.885867:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945216 00000100:00100000:0.0:1789480114.885875:0:6515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945216 00000100:00100000:3.0:1789480114.885892:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885911:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527946240:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885930:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480114.885939:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1789480114.885947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527946752:0@lo:400:kworker.0 00000100:00100000:0.0:1789480114.885948:0:6515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527945216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.885967:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.885993:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527945344:0@lo:400:kworker.0 00000100:00100000:0.0:1789480114.886002:0:6515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a86841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527945216:12345-0@lo:400:kworker.0 Request processed in 55us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480114.886009:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1789480114.886013:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527945856:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886065:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886097:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527946368:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886118:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886137:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527946880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480114.886161:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886180:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789480114.886186:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527945472:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886230:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886248:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527945984:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886266:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886280:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527946496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886301:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480114.886325:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945600 00000100:00100000:3.0:1789480114.886329:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945600 00000100:00100000:3.0:1789480114.886362:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945344 00000100:00100000:3.0:1789480114.886365:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945344 00000100:00100000:3.0:1789480114.886376:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945856 00000100:00100000:3.0:1789480114.886379:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945856 00000100:00100000:3.0:1789480114.886404:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946368 00000100:00100000:3.0:1789480114.886407:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946368 00000100:00100000:3.0:1789480114.886419:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945984 00000100:00100000:3.0:1789480114.886421:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945984 00000100:00100000:3.0:1789480114.886432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946496 00000100:00100000:3.0:1789480114.886434:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946496 00000100:00100000:3.0:1789480114.886446:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789480114.886452:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527945600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886489:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527945600:12345-0@lo:400:kworker.0 Request processed in 36us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886495:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789480114.886510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789480114.886515:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527945344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886544:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527945344:12345-0@lo:400:kworker.0 Request processed in 30us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789480114.886561:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789480114.886566:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527945856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886589:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527945856:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789480114.886605:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789480114.886611:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527946368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886635:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876405527946368:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789480114.886660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789480114.886665:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527945984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886693:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527945984:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886699:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789480114.886709:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789480114.886715:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527946496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886739:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527946496:12345-0@lo:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1789480114.886763:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946112 00000100:00100000:3.0:1789480114.886768:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946112 00000100:00100000:3.0:1789480114.886786:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946624 00000100:00100000:3.0:1789480114.886788:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946624 00000100:00100000:3.0:1789480114.886798:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946240 00000100:00100000:3.0:1789480114.886800:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946240 00000100:00100000:3.0:1789480114.886809:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946752 00000100:00100000:3.0:1789480114.886811:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946752 00000100:00100000:3.0:1789480114.886823:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789480114.886828:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527946112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886859:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527946112:12345-0@lo:400:kworker.0 Request processed in 30us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886865:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789480114.886877:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789480114.886885:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527946624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886923:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527946624:12345-0@lo:400:kworker.0 Request processed in 38us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886929:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789480114.886940:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789480114.886945:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527946240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.886973:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527946240:12345-0@lo:400:kworker.0 Request processed in 27us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.886979:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789480114.886989:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789480114.886995:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527946752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887033:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527946752:12345-0@lo:400:kworker.0 Request processed in 38us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.887039:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789480114.887062:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945728 00000100:00100000:3.0:1789480114.887065:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945728 00000100:00100000:3.0:1789480114.887083:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527946880 00000100:00100000:3.0:1789480114.887085:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527946880 00000100:00100000:3.0:1789480114.887093:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527945472 00000100:00100000:3.0:1789480114.887095:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527945472 00000100:00100000:3.0:1789480114.887108:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789480114.887113:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527945728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887143:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876405527945728:12345-0@lo:400:kworker.0 Request processed in 30us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.887148:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789480114.887160:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789480114.887165:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527946880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480114.887226:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789480114.887259:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527946880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.887265:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789480114.887277:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789480114.887283:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527945472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887307:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527945472:12345-0@lo:400:kworker.0 Request processed in 25us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480114.887313:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789480114.887365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69889f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527945216:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527945728:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887387:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527946240:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887397:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527946752:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887408:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb507b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527945600:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887417:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527946112:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527946624:0@lo:400:kworker.0 00000100:00080000:3.0:1789480114.887488:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480114.887493:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789480114.887495:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789480114.887497:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480114.887514:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527945472:0@lo:400:kworker.0 00010000:00080000:3.0:1789480114.887527:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6988b3bb80 x1876405527945984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480114.887550:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527945984:0@lo:400:kworker.0 00010000:00080000:3.0:1789480114.887563:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f7b80 x1876405527946496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480114.887572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527946496:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887583:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527945344:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887594:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527945856:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887603:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1876405527946368:0@lo:400:kworker.0 00000100:00100000:3.0:1789480114.887615:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527946880:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1789480115.140683:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789480115.140695:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480115.140797:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789480115.140805:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789480115.396628:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480115.396653:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527947008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789480115.396735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480115.396821:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527947136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480115.396848:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480115.396895:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947008 00000100:00100000:3.0:1789480115.396904:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947008 00000100:00100000:3.0:1789480115.396951:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947136 00000100:00100000:3.0:1789480115.396955:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947136 00000100:00100000:3.0:1789480115.396969:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789480115.396977:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527947008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480115.397008:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789480115.397066:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527947008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480115.397088:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789480115.397107:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789480115.397114:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527947136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480115.397125:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789480115.397156:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527947136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480115.397162:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789480115.397236:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527947136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480115.397267:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527947008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789480115.524709:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480115.910567:0:13808:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789480116.335906:0:15163:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789480116.359568:0:15163:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789480116.359637:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480116.359654:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480116.359682:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480116.359690:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480116.359720:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789480116.359726:0:15163:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789480116.359759:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480116.359764:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789480116.359771:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789480116.359804:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6ab980a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789480116.359901:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480116.359910:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.359926:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81486800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480116.359930:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.359939:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480116.359946:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480116.359952:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480116.359955:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789480116.359958:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789480116.359984:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.359990:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480116.360025:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.360032:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81486800/0xdaa289fda243d2a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2ab expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.360046:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480116.360048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480116.360049:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480116.360222:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527947264:0@lo:39:umount.0 00000100:00100000:0.0:1789480116.360304:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480116.360452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527947392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480116.360486:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480116.360584:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947392 00000100:00100000:0.0:1789480116.360602:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947392 00000100:00100000:0.0:1789480116.360656:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480116.360665:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+24:3648:x1876405527947392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480116.360679:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480116.360695:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bca00/0xdaa289fda243d2ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d2a4 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480116.360708:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480116.360743:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a679393-20ef-489d-b204-2797ec519e97+23:3648:x1876405527947392:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480116.360750:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789480116.360876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527947392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480116.360947:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947264 00000100:00100000:2.0:1789480116.360952:0:6521:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947264 00000100:00100000:2.0:1789480116.360995:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789480116.361002:0:6521:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876405527947264:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789480116.361045:0:6521:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce13 00000100:00080000:2.0:1789480116.361056:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f6000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789480116.361135:0:6521:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1876405527947264:12345-0@lo:39:umount.0 Request processed in 134us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480116.361142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000020:00000080:2.0:1789480116.361149:0:6521:0:(genops.c:885:class_export_put()) final put ffff8a6ab98f0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789480116.361225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab98f0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789480116.361292:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6ab98f6000 for lustre-MDT0000 00000100:00080000:1.0:1789480116.361363:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6ab980a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789480116.361383:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527947264:0@lo:39:umount.0 00000100:00080000:3.0:1789480116.361433:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480116.361437:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789480116.361442:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789480116.362907:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480116.365234:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365260:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365267:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365274:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365323:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480116.365331:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365337:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365342:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365348:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365368:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789480116.365376:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365383:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365389:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365396:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365410:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789480116.365416:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365429:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365436:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365443:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480116.365451:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1789480116.365454:0:15163:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789480116.365499:0:15163:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789480116.365504:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789480116.365588:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480116.365596:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1789480116.365604:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a6abb5d4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480116.365611:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a6abb483800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480116.365617:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a6abb079800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480116.365621:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a6abb079000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1789480116.365629:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a6987e51000 71ef009f-7b67-4186-8594-2437af8601ad 192.168.206.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480116.365634:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8a6987e10800 f7386f76-6ebd-4087-bc50-a71a216590e4 192.168.206.44@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1789480116.365639:0:15163:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a6a85e299c0) has exports, disconnecting them 00000020:00080000:3.0:1789480116.365644:0:15163:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a6abb5d4000), last request at 1789480114 00000020:00000080:3.0:1789480116.365653:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d123 00000100:00080000:3.0:1789480116.365681:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5d1000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789480116.365750:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6abb5d4000): rc 0 00000020:00000080:3.0:1789480116.365753:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb5d4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789480116.365765:0:15163:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a6abb483800), last request at 1789480114 00000020:00000080:3.0:1789480116.365768:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cffd 00000100:00080000:3.0:1789480116.365789:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb487800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789480116.365797:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6abb483800): rc 0 00000020:00000080:3.0:1789480116.365799:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb483800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1789480116.365803:0:15163:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a6abb079800), last request at 1789479861 00000020:00000080:3.0:1789480116.365806:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cefa 00000100:00080000:3.0:1789480116.365810:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07a800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789480116.365815:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6abb079800): rc 0 00000020:00000080:3.0:1789480116.365817:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb079800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1789480116.365821:0:15163:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a6abb079000), last request at 1789479861 00000020:00000080:3.0:1789480116.365824:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cebb 00000100:00080000:3.0:1789480116.365827:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480116.365834:0:15163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1789480116.365936:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6abb079000): rc 0 00000004:00000080:3.0:1789480116.365944:0:15163:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9c0c01b97ae0 00000100:00080000:3.0:1789480116.365966:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789480116.365970:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1789480116.366796:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789480116.366809:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.366819:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480116.366823:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.366834:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480116.366841:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480116.366847:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480116.366850:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1789480116.366853:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789480116.366900:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.366922:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480116.366953:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.366977:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243d2b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d2b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367001:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789480116.367005:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367021:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480116.367025:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367032:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480116.367044:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480116.367050:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480116.367052:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789480116.367054:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789480116.367072:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367078:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480116.367084:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367091:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0400/0xdaa289fda243d1b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d1bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367111:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480116.367115:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367121:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bce00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480116.367124:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367131:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480116.367138:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480116.367143:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789480116.367145:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789480116.367147:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789480116.367162:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367168:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480116.367186:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367210:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bce00/0xdaa289fda243d51a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d521 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367220:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480116.367224:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367236:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81474800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480116.367240:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367247:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480116.367254:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480116.367259:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789480116.367262:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789480116.367264:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789480116.367278:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367285:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480116.367291:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367298:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81474800/0xdaa289fda243cd72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243cd79 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.367310:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480116.367311:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480116.367313:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789480116.367330:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb5d4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789480116.367391:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb483800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789480116.367417:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb079800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789480116.367467:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb5d1000 for lustre-MDT0000 00000020:00000080:2.0:1789480116.367472:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb487800 for lustre-MDT0000 00000020:00000080:2.0:1789480116.367478:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb07a800 for lustre-MDT0000 00000100:00100000:2.0:1789480116.367502:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527947520:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480116.367763:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480116.367944:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480116.368241:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480116.368299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480116.368308:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527947648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480116.368330:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480116.368364:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527947776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480116.368386:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480116.368403:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480116.368408:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527947904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480116.368428:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480116.368460:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947520 00000100:00100000:2.0:1789480116.368469:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947520 00000100:00100000:0.0:1789480116.369689:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947648 00000100:00100000:0.0:1789480116.369701:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947648 00000100:00100000:0.0:1789480116.369746:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947776 00000100:00100000:0.0:1789480116.369749:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947776 00000100:00100000:0.0:1789480116.369761:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527947904 00000100:00100000:0.0:1789480116.369764:0:6506:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527947904 00000100:00100000:0.0:1789480116.369795:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480116.369805:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+26:3645:x1876405527947648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480116.369822:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480116.369842:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243d1bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d1b6 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480116.369859:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480116.369953:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+25:3645:x1876405527947648:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480116.369961:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480116.369995:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789480116.370000:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+24:3647:x1876405527947776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480116.370008:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480116.370029:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243d521 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d51a expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480116.370038:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480116.370066:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+23:3647:x1876405527947776:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480116.370072:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789480116.370084:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789480116.370095:0:6506:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+22:3647:x1876405527947904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480116.370103:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480116.370112:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a80030e00/0xdaa289fda243cd79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243cd72 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480116.370123:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480116.370144:0:6506:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a679393-20ef-489d-b204-2797ec519e97+21:3647:x1876405527947904:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480116.370150:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789480116.370232:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789480116.370235:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527947904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480116.370251:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527947776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480116.370292:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527947648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480116.370309:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+20:3645:x1876405527947520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480116.370323:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480116.370335:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81487800/0xdaa289fda243d2b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d2b2 expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480116.370347:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480116.370391:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a679393-20ef-489d-b204-2797ec519e97+19:3645:x1876405527947520:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480116.370399:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789480116.370851:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527947520:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789480116.371437:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789480116.371469:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb3c9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789480116.371592:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948032:0@lo:39:umount.0 00000100:00100000:1.0:1789480116.371656:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480116.371786:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948032 00000100:00100000:2.0:1789480116.371794:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948032 00000100:00100000:2.0:1789480116.371870:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789480116.371878:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876405527948032:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789480116.371923:0:6526:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cf55 00000100:00080000:2.0:1789480116.371932:0:6526:0:(import.c:65:import_set_state_nolock()) ffff8a6abb482000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789480116.371960:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789480116.372316:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480116.372734:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789480116.372739:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1789480116.372762:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789480116.372838:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789480116.372858:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6abb67a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789480116.373108:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948160:0@lo:9:umount.0 00000100:00100000:1.0:1789480116.373159:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480116.373258:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948160 00000100:00100000:0.0:1789480116.373273:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948160 00000100:00100000:0.0:1789480116.373331:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789480116.373340:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876405527948160:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789480116.373362:0:8493:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d0b3 00000100:00080000:0.0:1789480116.373370:0:8493:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789480116.373416:0:8493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789480116.373562:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1876405527948160:12345-0@lo:9:umount.0 Request processed in 223us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480116.373569:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1789480116.373592:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789480116.373606:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480116.373738:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3644:x1876405527948032:12345-0@lo:39:umount.0 Request processed in 1858us (2079us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789480116.373748:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1789480116.373879:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789480116.373883:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:3.0:1789480116.373902:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789480116.374100:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789480116.374120:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6987527000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789480116.374157:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a6a85e299c0) has no exports 00000100:00080000:1.0:1789480116.375442:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb3c9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789480116.375457:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948032:0@lo:39:umount.0 00000100:00100000:1.0:1789480116.375493:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948288:0@lo:9:umount.0 00000100:00100000:1.0:1789480116.375652:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480116.375700:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb67a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480116.375758:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:3.0:1789480116.375810:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948288 00000100:00100000:3.0:1789480116.375817:0:8435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948288 00000100:00100000:3.0:1789480116.375878:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789480116.375888:0:8435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876405527948288:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789480116.375933:0:8435:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d1e7 00000100:00080000:3.0:1789480116.375943:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8a6987e13800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480116.375994:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789480116.376145:0:8435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3644:x1876405527948288:12345-0@lo:9:umount.0 Request processed in 258us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480116.376152:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789480116.376429:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789480116.376441:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789480116.376540:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480116.376546:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948160:0@lo:9:umount.0 00000100:00080000:1.0:1789480116.376587:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987527000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789480116.376602:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789480116.376604:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480116.376607:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527948288:0@lo:9:umount.0 00000020:00080000:3.0:1789480116.384387:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a6a85e299c0) has no exports 00000020:00000080:3.0:1789480116.449294:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cdcd 00000020:00000080:3.0:1789480116.449314:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a881b2800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789480116.449340:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789480116.450915:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a881b2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789480116.450931:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480116.450947:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789480116.450953:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a6aafafb380) has no exports 00000020:00000080:2.0:1789480116.454739:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cdc6 00000020:00000080:2.0:1789480116.454756:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6aafb17000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789480116.454836:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480116.454849:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789480116.454852:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a881b2000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789480116.454856:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a881b2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789480116.454863:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789480116.455922:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6aafb17000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789480116.551110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480117.446914:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789480117.446953:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527948416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480117.447052:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480117.447380:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948416 00000100:00100000:3.0:1789480117.447390:0:8438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948416 00000100:00100000:3.0:1789480117.447479:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789480117.447489:0:8438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527948416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789480117.447523:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789480117.447608:0:8438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527948416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480117.447615:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789480117.448041:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527948416:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789480117.448112:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789480117.572492:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480117.958697:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480117.958730:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527948544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480117.958799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1789480117.960625:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480117.960632:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6987e15000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789480117.960657:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480117.960659:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6a8611a000/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480117.960677:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e15000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789480117.960722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a8611a000/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-OST0001 00000020:00000080:1.0:1789480117.960747:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e13800 for lustre-OST0001 00000020:00000080:1.0:1789480117.960752:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6a8611b000 for lustre-OST0001 00000001:00100000:1.0:1789480117.961231:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789480117.961236:0:8430:0:(genops.c:885:class_export_put()) final put ffff8a6abb5cc800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789480117.961248:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480117.961250:0:8430:0:(genops.c:885:class_export_put()) final put ffff8a6ac1b31800/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480117.961273:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb5cc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789480117.961299:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ac1b31800/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-OST0000 00000020:00000080:1.0:1789480117.961316:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb5cd800 for lustre-OST0000 00000020:00000080:1.0:1789480117.961319:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6ac1b32800 for lustre-OST0000 00000100:00100000:3.0:1789480117.962178:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948544 00000100:00100000:3.0:1789480117.962208:0:6525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948544 00000100:00100000:3.0:1789480117.962275:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789480117.962284:0:6525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1876405527948544:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1789480117.962293:0:6525:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789480117.962392:0:6525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3645:x1876405527948544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (3592us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789480117.962400:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:02020000:0.0:1789480117.962655:0:3645:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:3.0:1789480117.969336:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789480117.969357:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1789480117.969364:0:7452:0:(genops.c:885:class_export_put()) final put ffff8a6abb487000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789480117.969395:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000001:00080000:3.0:1789480117.969403:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1789480117.969405:0:7452:0:(genops.c:885:class_export_put()) final put ffff8a6987e55000/71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:3.0:1789480117.969411:0:7452:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000001:00080000:3.0:1789480117.969414:0:7452:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1789480117.969416:0:7452:0:(genops.c:885:class_export_put()) final put ffff8a6987e10000/f7386f76-6ebd-4087-bc50-a71a216590e4 00000020:00000080:1.0:1789480117.969770:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb487000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1789480117.969850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e55000/71ef009f-7b67-4186-8594-2437af8601ad for lustre-MDT0001 00000020:00000080:1.0:1789480117.969884:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e10000/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-MDT0001 00000020:00000080:1.0:1789480117.969915:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb482000 for lustre-MDT0001 00000020:00000080:1.0:1789480117.969920:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e50000 for lustre-MDT0001 00000020:00000080:1.0:1789480117.969923:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e16000 for lustre-MDT0001 00000100:00080000:0.0:1789480117.973227:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480117.973234:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789480117.973239:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480117.987717:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480117.987730:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 230 00000100:00080000:0.0:1789480117.987748:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a6abb07d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480117.988262:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d5f80 x1876405527948672/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480117.989822:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527948672:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789480117.989889:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480117.990083:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948672 00000100:00100000:2.0:1789480117.990093:0:6526:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948672 00000100:00100000:2.0:1789480117.990139:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789480117.990148:0:6526:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527948672:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789480117.990167:0:6526:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789480117.992887:0:6526:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527948672:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2730us (2988us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480117.992902:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000001:00100000:3.0:1789480117.993662:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789480117.993669:0:6499:0:(genops.c:885:class_export_put()) final put ffff8a6abb079000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789480117.993703:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 71ef009f-7b67-4186-8594-2437af8601ad 00000001:00080000:3.0:1789480117.993713:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1789480117.993716:0:6499:0:(genops.c:885:class_export_put()) final put ffff8a6987e51000/71ef009f-7b67-4186-8594-2437af8601ad 00000001:00100000:3.0:1789480117.993721:0:6499:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f7386f76-6ebd-4087-bc50-a71a216590e4 00000001:00080000:3.0:1789480117.993725:0:6499:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789480117.993731:0:6499:0:(genops.c:885:class_export_put()) final put ffff8a6987e10800/f7386f76-6ebd-4087-bc50-a71a216590e4 00000100:00080000:3.0:1789480117.993882:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480117.993889:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789480117.993893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527948672:0@lo:38:ptlrpcd_00_00.0 00000020:00000080:1.0:1789480117.994347:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb079000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789480117.994413:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e51000/71ef009f-7b67-4186-8594-2437af8601ad for lustre-MDT0000 00000020:00000080:1.0:1789480117.994444:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987e10800/f7386f76-6ebd-4087-bc50-a71a216590e4 for lustre-MDT0000 00000020:00000080:1.0:1789480117.994474:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb07c000 for lustre-MDT0000 00000020:00000080:1.0:1789480117.994479:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e55800 for lustre-MDT0000 00000020:00000080:1.0:1789480117.994482:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987e12000 for lustre-MDT0000 00000020:01000000:2.0:1789480118.471344:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a69878d1360 - data ffff8a6a9632f5e8/ffff8a6987dd7400 00000020:01000000:2.0:1789480118.471519:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6aafb8fe40 - data ffff8a6a961255e8/ffff8a6ab98fbc00 00000001:00000004:2.0:1789480118.477073:0:15163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1789480118.557383:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789480118.557391:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1789480118.557405:0:15163:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a6986a1d180 x1876405527948032/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789480126 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480118.557433:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1789480118.559669:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789480118.559679:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1789480118.559699:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480118.559701:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789480118.560441:0:8490:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789480118.560446:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789480118.560466:0:8490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789480118.561105:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789480118.561110:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1789480118.561130:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480118.561133:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789480118.563507:0:9886:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789480118.563514:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789480118.563526:0:9886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789480118.565909:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cd95 00000020:00000080:1.0:1789480118.565923:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a866cb800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789480118.568502:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cdaa 00000020:00000080:1.0:1789480118.568517:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a97c44000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480118.569163:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a866cb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789480118.569664:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789480118.569670:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480118.569678:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480118.569681:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a6a85e10000) has no exports 00000004:01000000:1.0:1789480118.569856:0:15163:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789480118.569864:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d1e0 00000020:00000080:1.0:1789480118.569872:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6987520800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789480118.569877:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789480118.569881:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480118.569890:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480118.569893:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 28 (ffff8a6987948000) has no exports 00000020:00000080:1.0:1789480118.569898:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d1d9 00000020:00000080:1.0:1789480118.569901:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6987521000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789480118.570110:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c44000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789480118.570119:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987520800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789480118.570123:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987521000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789480118.570555:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789480118.570559:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789480118.570564:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789480118.570569:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480118.570571:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480118.570613:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480118.570621:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480118.570627:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d09e 00000020:00000080:1.0:1789480118.570632:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6986b0c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789480118.570636:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789480118.570640:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480118.570652:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480118.570655:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff8a6ac1ac4d40) has no exports 00000020:00000080:1.0:1789480118.570659:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d097 00000020:00000080:1.0:1789480118.570661:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb679800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789480118.570986:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000020:00000080:0.0:1789480118.571070:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987527000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789480118.571079:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6981c93800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480118.571081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6981c93800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789480118.571086:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.571230:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b0c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789480118.571234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb679800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1789480118.571429:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789480118.571433:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789480118.571437:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480118.571439:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480118.571480:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480118.571487:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789480118.571498:0:15163:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789480118.571503:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cf4e 00000020:00000080:1.0:1789480118.571508:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb485800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789480118.571512:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789480118.571516:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480118.571520:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480118.571523:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a6a85e14d40) has no exports 00000020:00000080:1.0:1789480118.571527:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cf47 00000020:00000080:1.0:1789480118.571530:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6abb3c8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789480118.574890:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb67a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789480118.574908:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6abb67b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480118.574912:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb67b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789480118.574920:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.575042:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb485800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789480118.575048:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789480118.575703:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789480118.575709:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789480118.575713:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789480118.575721:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480118.575842:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb3c9800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789480118.575893:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.575905:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.575910:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6ab328f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480118.575913:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab328f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789480118.575918:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.576880:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.576901:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.576906:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a866ce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789480118.576908:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a866ce800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789480118.576914:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480118.576997:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cdb1 00000020:00000080:0.0:1789480118.577018:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a97c41000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789480118.577076:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789480118.577081:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480118.577087:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789480118.577091:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a6a85e2cd40) has no exports 00000020:00000080:0.0:1789480118.577113:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.577117:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789480118.577122:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cdb8 00000020:00000080:0.0:1789480118.577126:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a97c45800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789480118.579445:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c41000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789480118.579459:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6a97c42800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789480118.579462:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c42800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789480118.579472:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1789480118.581930:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6a83cfb000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789480118.581939:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6a83cfb000 3 00000020:01000004:0.0:1789480118.581943:0:15163:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a6a83cfb000 from lustre-MDT0000 00000020:00000080:0.0:1789480118.581985:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.583172:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789480118.583180:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a97c47000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789480118.583184:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c47000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789480118.583220:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789480118.583311:0:15163:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789480118.583317:0:15163:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789480118.583321:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789480118.583325:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480118.583329:0:15163:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480118.583336:0:15163:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a6a95dd1800 6a679393-20ef-489d-b204-2797ec519e97 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480118.583342:0:15163:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a6a95c98000) has exports, disconnecting them 00000020:00080000:0.0:1789480118.583347:0:15163:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a6a95dd1800), last request at 1789479838 00000020:00000080:0.0:1789480118.583363:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cd56 00000020:00010000:0.0:1789480118.583368:0:15163:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a6a95dd1800: total 1 00000100:00080000:0.0:1789480118.583385:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789480118.583404:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6a95dd1800): rc 0 00000020:00080000:0.0:1789480118.583409:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a6a95c98000) has no exports 00000020:00010000:0.0:1789480118.583425:0:9524:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a6a95dd1800: total 1 00010000:00010000:0.0:1789480118.583452:0:9524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a6a95dd1800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789480118.583484:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047b600/0xdaa289fda243d273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d26c expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583501:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c6200/0xdaa289fda243d281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d27a expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583512:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243d28f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d288 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583521:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6a81486400/0xdaa289fda243d29d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d296 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583531:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047ae00/0xdaa289fda243ce52 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243ce4b expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583546:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a800/0xdaa289fda243ce60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243ce59 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583557:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243d4f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d4f0 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583565:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243d505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d4fe expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583576:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6aa33c7800/0xdaa289fda243d265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d25e expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583600:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243d513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d50c expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583612:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243d177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d170 expref: 4 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583624:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243d2c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d2c0 expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583634:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047b200/0xdaa289fda243d257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdaa289fda243d250 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480118.583645:0:9524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a6a95dd1800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789480118.583660:0:9524:0:(genops.c:885:class_export_put()) final put ffff8a6a95dd1800/6a679393-20ef-489d-b204-2797ec519e97 00010000:00010000:0.0:1789480118.583667:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480118.583669:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480118.583671:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480118.583739:0:6515:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a6aa23cfe00:6515] 2 exiting: rc = 0 00000100:00100000:2.0:1789480118.584340:0:6512:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a6aa3560c00:6512] 0 exiting: rc = 1 00000020:00000080:2.0:1789480118.584398:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789480118.584409:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a95dd1800/6a679393-20ef-489d-b204-2797ec519e97 for MGS 00000020:00000080:2.0:1789480118.584440:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6a95dd2800 for MGS 00000100:00100000:3.0:1789480118.586947:0:6514:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a6aaa3f9e00:6514] 1 exiting: rc = 0 00000100:00100000:0.0:1789480118.587568:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587578:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587585:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587592:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587597:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587603:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587609:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587615:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587622:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587627:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587633:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587638:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587644:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587661:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587667:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587673:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587678:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587683:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587688:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587693:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587700:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587705:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587711:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587716:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587722:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587728:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587734:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587740:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587745:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587751:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587757:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587775:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587781:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587786:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587792:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587798:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587804:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587810:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587816:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587821:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587827:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587832:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587838:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587843:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587848:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587853:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587858:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587864:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587877:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587882:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587887:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587893:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587897:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587902:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587908:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587913:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587918:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587923:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587929:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587935:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587940:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587946:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587952:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480118.587957:0:15163:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789480118.590112:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6987abbc60 - data ffff8a69860b6870/ffff8a6987e0d800 00000020:01000000:0.0:1789480118.590359:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6a95c72b40 - data ffff8a6a9605c438/ffff8a6aaa2e5400 00000020:00000080:0.0:1789480118.591158:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cd3a 00000020:00000080:0.0:1789480118.591168:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a83cfa800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789480118.591321:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a83cfa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789480118.591384:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6a83cfb000 from MGS, refs=2 00000020:01000004:0.0:1789480118.591388:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6a83cfb000 2 00000020:01000004:0.0:1789480118.591391:0:15163:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a6a83cfb000 from MGS 00000020:00000080:0.0:1789480118.591411:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480118.591417:0:15163:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789480118.591420:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a909d4000/MGS 00000020:00000080:0.0:1789480118.591422:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a909d4000/MGS for MGS 00000020:01000000:0.0:1789480118.591428:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789480118.591487:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789480118.591491:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480118.591495:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480118.591501:0:15163:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a6a97c48000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480118.591518:0:15163:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8a6aafaf8000) has exports, disconnecting them 00000020:00080000:0.0:1789480118.591523:0:15163:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a6a97c48000), last request at 1789479839 00000020:00000080:0.0:1789480118.591527:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce05 00000020:00080000:0.0:1789480118.591536:0:15163:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6a97c48000): rc 0 00000020:00000080:0.0:1789480118.591539:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a97c48000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789480118.591562:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c48000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:00010000:2.0:1789480118.596593:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:01000000:2.0:1789480118.601269:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789480118.601278:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480118.601283:0:15163:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789480118.601296:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480118.601535:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480118.601543:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789480118.601551:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6a83cfb000 1 00000020:00000080:2.0:1789480118.601560:0:15163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cd2c 00000020:00000080:2.0:1789480118.601569:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a909d1000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789480118.601574:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789480118.601579:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480118.601583:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789480118.601587:0:15163:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a6a95c9b380) has no exports 00000020:00000080:2.0:1789480118.610091:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6ab980a800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789480118.610107:0:13097:0:(genops.c:885:class_export_put()) final put ffff8a6aafb11000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789480118.610119:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6aafb11000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789480118.610136:0:13097:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789480118.610230:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a909d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789480118.759451:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480118.759483:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789480118.759491:0:15163:0:(genops.c:885:class_export_put()) final put ffff8a6a83cfa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789480118.759498:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a83cfa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789480118.759523:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789480118.759695:0:15163:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a6a83cfb800 00000020:02000400:3.0:1789480118.759772:0:15163:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789480119.627083:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480120.006109:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480120.006117:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789480120.006122:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480120.006132:0:13097:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 486 00000100:00080000:0.0:1789480120.006139:0:13097:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789480120.006152:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a6abb07d800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480120.006180:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2ea00 x1876405527948928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480120.006309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527948800:0@lo:400:kworker.0 00000400:00000100:0.0:1789480120.006364:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405527948800 offset 0 length 224: 4 00000100:00100000:0.0:1789480120.006414:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527949440:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.006447:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.006475:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789480120.006480:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527949056:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.006571:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.006590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527949568:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.006608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007045:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527948928:0@lo:38:kworker.0 00000100:00100000:0.0:1789480120.007089:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007127:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527949184:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.007150:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007168:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527949696:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.007209:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007233:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789480120.007239:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527949312:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.007261:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007278:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527949824:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.007300:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.007334:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949440 00000100:00100000:0.0:1789480120.007343:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949440 00000100:00100000:0.0:1789480120.007405:0:8493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949824 00000100:00100000:0.0:1789480120.007408:0:8493:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949824 00000100:00100000:0.0:1789480120.007433:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789480120.007441:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527949440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.007696:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527949440:12345-0@lo:400:kworker.0 Request processed in 254us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480120.007704:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789480120.007724:0:8493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789480120.007730:0:8493:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527949824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.008869:0:8493:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527949824:12345-0@lo:400:kworker.0 Request processed in 1132us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480120.008881:0:8493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789480120.008917:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949056 00000100:00100000:0.0:1789480120.008924:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949056 00000100:00100000:0.0:1789480120.008955:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949568 00000100:00100000:0.0:1789480120.008958:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949568 00000100:00100000:0.0:1789480120.008966:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949184 00000100:00100000:0.0:1789480120.008968:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949184 00000100:00100000:0.0:1789480120.008976:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949696 00000100:00100000:0.0:1789480120.008978:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949696 00000100:00100000:0.0:1789480120.009007:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949312 00000100:00100000:0.0:1789480120.009010:0:6522:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949312 00000100:00100000:0.0:1789480120.009026:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789480120.009033:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527949696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.009080:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527949696:12345-0@lo:400:kworker.0 Request processed in 47us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480120.009086:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1789480120.009100:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789480120.009107:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527949312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.009133:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527949312:12345-0@lo:400:kworker.0 Request processed in 28us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480120.009138:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1789480120.009150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789480120.009155:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876405527949056:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789480120.009161:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789480120.009184:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876405527949056:12345-0@lo:400:kworker.0 Request processed in 28us (2612us total) trans 0 rc -107/-107 00010000:00080000:2.0:1789480120.009319:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a6ac1c2d880 x1876405527949312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480120.009335:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527949312:0@lo:400:kworker.0 00000100:00100000:2.0:1789480120.009351:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527949824:0@lo:400:kworker.0 00010000:00080000:2.0:1789480120.009362:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a6abb58a680 x1876405527949696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480120.009371:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527949696:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.009445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789480120.009459:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789480120.009464:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876405527949568:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789480120.009469:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789480120.009694:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3647:x1876405527949568:12345-0@lo:400:kworker.0 Request processed in 228us (3084us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789480120.009705:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789480120.009719:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789480120.009723:0:6522:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876405527949184:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789480120.009728:0:6522:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789480120.010300:0:6522:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3645:x1876405527949184:12345-0@lo:400:kworker.0 Request processed in 572us (3145us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789480120.010308:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789480120.010344:0:7836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527948928 00000100:00100000:0.0:1789480120.010352:0:7836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527948928 00000100:00100000:0.0:1789480120.010382:0:7836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789480120.010387:0:7836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876405527948928:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789480120.010407:0:7836:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789480120.010444:0:7836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876405527948928:12345-0@lo:38:kworker.0 Request processed in 57us (3355us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789480120.010450:0:7836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:2.0:1789480120.010601:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789480120.010689:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789480120.010695:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480120.010783:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480120.010791:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789480120.010793:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480120.010832:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480120.010838:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480120.010842:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527948928:0@lo:38:kworker.0 00000100:00080000:0.0:1789480120.010893:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480120.010897:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b1800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789480120.010900:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480120.010905:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480120.010918:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 230 00000100:00080000:0.0:1789480120.010929:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a6abb2b1800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480120.010958:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6abb58aa00 x1876405527949952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480120.010979:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527949056:0@lo:400:kworker.0 00000100:00080000:0.0:1789480120.010991:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480120.011005:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789480120.011009:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789480120.011012:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480120.011015:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 276 00000100:00080000:0.0:1789480120.011020:0:3647:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a6981c91800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480120.011032:0:3647:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6abb58b800 x1876405527950080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480120.011042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527949568:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.011062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527949440:0@lo:400:kworker.0 00000100:00100000:0.0:1789480120.011088:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527949952:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789480120.011128:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.011149:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527950080:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789480120.011166:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480120.013422:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527949952 00000100:00100000:0.0:1789480120.013435:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527949952 00000100:00100000:0.0:1789480120.013480:0:12158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950080 00000100:00100000:0.0:1789480120.013483:0:12158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950080 00000100:00100000:0.0:1789480120.013516:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789480120.013525:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876405527949952:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1789480120.013549:0:12158:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789480120.013703:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876405527949952:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 178us (2574us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789480120.013712:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789480120.013731:0:12158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789480120.013735:0:12158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876405527950080:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1789480120.013746:0:12158:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789480120.013840:0:12158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1876405527950080:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 102us (2671us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789480120.013846:0:12158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1789480120.013915:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480120.013921:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480120.013925:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527949952:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1789480120.013934:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480120.013937:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480120.013939:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527950080:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1789480120.032749:0:3645:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480120.032765:0:3645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 250 00000100:00080000:2.0:1789480120.032782:0:3645:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a6ab98f3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480120.032823:0:3645:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a7bb80 x1876405527950208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480120.032870:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527949184:0@lo:400:kworker.0 00000100:00100000:2.0:1789480120.032887:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527950208:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789480120.032957:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480120.033037:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950208 00000100:00100000:2.0:1789480120.033054:0:6520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950208 00000100:00100000:2.0:1789480120.033100:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789480120.033107:0:6520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527950208:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1789480120.033131:0:6520:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789480120.033169:0:6520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527950208:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (212us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480120.033176:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789480120.037942:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480120.037958:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480120.037964:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527950208:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1789480120.524018:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527950336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480120.524105:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480120.524219:0:10515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950336 00000100:00100000:2.0:1789480120.524227:0:10515:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950336 00000100:00100000:2.0:1789480120.524273:0:10515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789480120.524281:0:10515:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527950336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480120.524312:0:10515:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789480120.524364:0:10515:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527950336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480120.524372:0:10515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789480120.524423:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527950336:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789480120.649146:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480121.676024:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789480122.542415:0:15364:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00100000:3.0:1789480122.565918:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527950464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480122.566026:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480122.566168:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950464 00000100:00100000:1.0:1789480122.566178:0:8439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950464 00000100:00100000:1.0:1789480122.566312:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789480122.566321:0:8439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527950464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789480122.566357:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789480122.566410:0:8439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527950464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480122.566417:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789480122.566468:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527950464:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1789480122.566548:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1789480122.567006:0:15364:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1789480122.567061:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.567903:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.567914:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.567921:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.567946:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789480122.567953:0:15364:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789480122.567998:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480122.568004:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789480122.568010:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789480122.568017:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b1800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789480122.568024:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480122.568026:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789480122.568029:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789480122.569516:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480122.569531:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.569543:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480122.569548:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.569588:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480122.569596:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.569602:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480122.569605:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789480122.569608:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789480122.569654:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.569661:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789480122.569727:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527950592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480122.569821:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480122.570109:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950592 00000100:00100000:3.0:1789480122.570119:0:9525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950592 00000100:00100000:3.0:1789480122.570183:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789480122.570213:0:9525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a8bc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876405527950592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789480122.570221:0:9525:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480122 with bad export cookie 15754306168937499990 00010000:00010000:0.0:1789480122.570491:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.570501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6000/0xdaa289fda243d288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d28f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.570515:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.570517:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.570520:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.575701:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575727:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575736:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575767:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575794:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480122.575820:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480122.575828:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575836:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c7a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480122.575841:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575850:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480122.575858:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.575865:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480122.575868:0:9524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789480122.575907:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575914:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480122.575945:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575953:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7a00/0xdaa289fda243d296 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d29d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.575997:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576000:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576006:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480122.576039:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527950720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480122.576127:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789480122.576233:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576242:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576248:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576256:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576275:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480122.576284:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576292:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576295:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480122.576302:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576311:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576313:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576327:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475c00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480122.576335:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576343:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480122.576356:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480122.576365:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576373:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576377:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480122.576385:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480122.576393:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576406:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480122.576408:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789480122.576420:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789480122.576427:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:0.0:1789480122.576432:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.576441:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789480122.576444:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789480122.576447:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789480122.576466:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576475:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576476:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480122.576490:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480122.576510:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576519:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576520:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc000/0xdaa289fda243d50c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d513 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480122.576569:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475c00/0xdaa289fda243d170 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243d177 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576584:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576587:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480122.576590:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480122.576593:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480122.576595:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576604:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576615:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480122.576618:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527950976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480122.576636:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576645:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576663:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480122.576667:0:15364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789480122.576671:0:15364:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000100:00100000:1.0:1789480122.576699:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789480122.576713:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480122.576719:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576728:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475e00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480122.576731:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576740:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480122.576747:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480122.576765:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480122.576767:0:9524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00000100:00100000:1.0:1789480122.576770:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 10000000:01000000:0.0:1789480122.576770:0:9524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1789480122.576787:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527950848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480122.576802:0:9524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576811:0:9524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480122.576825:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576832:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475e00/0xdaa289fda243ce59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdaa289fda243ce60 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480122.576848:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576850:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.576852:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480122.576863:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480122.576875:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527951104:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1789480122.576921:0:15364:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789480122.576926:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789480122.576931:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480122.576938:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789480122.576943:0:15364:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a6987a5b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480122.576949:0:15364:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff8a6986b08800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1789480122.576960:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789480122.576965:0:15364:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff8a6ab9ba3380) has exports, disconnecting them 00000020:00080000:0.0:1789480122.576973:0:15364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a6987a5b000), last request at 1789480120 00000020:00000080:0.0:1789480122.576996:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d138 00000100:00080000:0.0:1789480122.577021:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789480122.577028:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950720 00000100:00100000:1.0:1789480122.577040:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950720 00010000:00010000:0.0:1789480122.577081:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480122.577083:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950976 00000100:00100000:1.0:1789480122.577088:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950976 00000100:00100000:1.0:1789480122.577101:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527950848 00000020:00080000:0.0:1789480122.577101:0:15364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6987a5b000): rc 0 00000100:00100000:1.0:1789480122.577110:0:6505:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527950848 00000020:00000080:0.0:1789480122.577112:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6987a5b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789480122.577127:0:15364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a6986b08800), last request at 1789480120 00000020:00000080:0.0:1789480122.577132:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d012 00000100:00100000:1.0:1789480122.577137:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789480122.577140:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6986b0b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789480122.577148:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1876405527950720:12345-0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789480122.577158:0:15364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6986b08800): rc 0 00010000:00020000:1.0:1789480122.577160:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480122 with bad export cookie 15754306168937499990 00000020:00000080:0.0:1789480122.577164:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6986b08800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789480122.577173:0:15364:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9c0c01c83ae0 00000100:00080000:0.0:1789480122.577234:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480122.577244:0:15364:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a69888d5880 x1876405527948544/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789480133 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480122.577255:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:1.0:1789480122.577310:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb58a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1876405527950720:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (1183us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480122.577319:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480122.577338:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480122.577342:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876405527950976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789480122.577347:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480122 with bad export cookie 15754306168937499990 00000100:00100000:1.0:1789480122.577378:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876405527950976:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (685us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480122.577384:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480122.577394:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789480122.577398:0:6505:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876405527950848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789480122.577403:0:6505:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480122 with bad export cookie 15754306168937499990 00000100:00100000:1.0:1789480122.577425:0:6505:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3648:x1876405527950848:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (473us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789480122.577431:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789480122.577464:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480122.577620:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789480122.577625:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789480122.577629:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:2.0:1789480122.577748:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987a5b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789480122.577793:0:13097:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b08800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789480122.577830:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987a5a000 for lustre-MDT0001 00000020:00000080:2.0:1789480122.577835:0:13097:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6986b0b000 for lustre-MDT0001 00000100:00100000:2.0:1789480122.577853:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527951104 00000100:00100000:2.0:1789480122.577861:0:6507:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527951104 00000100:00100000:2.0:1789480122.577899:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480122.577906:0:6507:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1876405527951104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789480122.577913:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789480122 with bad export cookie 15754306168937499990 00000100:00100000:2.0:1789480122.577969:0:6507:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3646:x1876405527951104:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (504us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789480122.577976:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480122.578019:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527948544:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789480122.579845:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789480122.582701:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789480122.582716:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6abb07d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789480122.583296:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789480122.583303:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789480122.583318:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789480122.583388:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789480122.583420:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5cf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789480122.583447:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789480122.583450:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789480122.583459:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789480122.583519:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789480122.583528:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789480122.583555:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a6ab9ba3380) has no exports 00000100:00100000:3.0:1789480122.586176:0:9525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a8bc5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876405527950592:12345-0@lo:103:ldlm_bl.0 Request processed in 15956us (16347us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789480122.586228:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789480122.586450:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1789480122.587385:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527951232:0@lo:9:umount.0 00000100:00100000:3.0:1789480122.590943:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480122.591041:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527951360:0@lo:9:umount.0 00000100:00100000:3.0:1789480122.591175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480122.591249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480122.597332:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527951232 00000100:00100000:3.0:1789480122.597352:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527951232 00000100:00100000:3.0:1789480122.597434:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527951360 00000100:00100000:3.0:1789480122.597438:0:8434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527951360 00000100:00100000:3.0:1789480122.597480:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789480122.597491:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876405527951232:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789480122.597527:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d05f 00000100:00080000:3.0:1789480122.597539:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a6abb3cf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480122.597592:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789480122.597818:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876405527951232:12345-0@lo:9:umount.0 Request processed in 328us (6884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480122.597826:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789480122.598553:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789480122.598568:0:8434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876405527951360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789480122.598590:0:8434:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d1a1 00000100:00080000:3.0:1789480122.598598:0:8434:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789480122.598637:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789480122.598762:0:8434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3644:x1876405527951360:12345-0@lo:9:umount.0 Request processed in 198us (7586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480122.598769:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1789480122.598803:0:6516:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789480122.600220:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb5cf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789480122.600249:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789480122.600253:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789480122.600259:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527951232:0@lo:9:umount.0 00000100:00080000:3.0:1789480122.600286:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6abb2b6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789480122.600297:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789480122.600299:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789480122.600302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527951360:0@lo:9:umount.0 00000100:00080000:1.0:1789480122.609608:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.144@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789480122.609629:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789480122.609638:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6ac1c2df80 x1876405527948800/t0(0) o400->MGC192.168.206.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789480136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480122.609667:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6abb58aa00 x1876405527950592/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480138 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480122.609677:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6abb58b800 x1876405527950720/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480138 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480122.609744:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6a679393-20ef-489d-b204-2797ec519e97:3647:1876405527948800:0@lo:400:kworker.0 00000100:00100000:1.0:1789480122.611083:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6abb58a300 x1876405527950976/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480138 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480122.611106:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d6680 x1876405527950848/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480138 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480122.611115:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6988a60e00 x1876405527951104/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789480138 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789480122.611125:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789480122.611128:0:3646:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789480122.611129:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789480122.612873:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a6a95dd3800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1789480122.612978:0:3645:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a6a95dd3800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:0.0:1789480122.613071:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480122.613087:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480122.613111:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6a679393-20ef-489d-b204-2797ec519e97:3645:1876405527950592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480122.613870:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527950976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480122.613888:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6a679393-20ef-489d-b204-2797ec519e97:3648:1876405527950848:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789480122.616947:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480122.616960:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 207 00000100:00080000:1.0:1789480122.616976:0:3646:0:(import.c:666:import_select_connection()) MGC192.168.206.144@tcp: import ffff8a6a95dd3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480122.617158:0:3646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d5c00 x1876405527951488/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480122.617232:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527951104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480122.617240:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6a679393-20ef-489d-b204-2797ec519e97:3646:1876405527950720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480122.617369:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527951488:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789480122.617434:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405527951488 offset 0 length 520: 4 00000020:00080000:2.0:1789480122.630611:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a6ab9ba3380) has no exports 00000020:01000000:3.0:1789480122.684727:0:15364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a69878d12a0 - data ffff8a6a96163798/ffff8a6987dd5c00 00000020:01000000:3.0:1789480122.684933:0:15364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6a97d1dea0 - data ffff8a6a961aa360/ffff8a6abb46b400 00010000:00010000:1.0:1789480122.694880:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789480122.702352:0:15364:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789480122.775662:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789480122.775670:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789480122.775678:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789480122.780562:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789480122.780569:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789480122.780588:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789480122.780590:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789480122.780947:0:8484:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789480122.780952:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789480122.780961:0:8484:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789480122.781565:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789480122.781569:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789480122.781587:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789480122.781588:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789480122.781955:0:9878:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789480122.781959:0:9878:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1789480122.781967:0:9878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789480122.788441:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce7c 00000020:00000080:1.0:1789480122.788518:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb1000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.792583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789480122.792699:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce91 00000020:00000080:1.0:1789480122.792709:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb6800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789480122.792812:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1789480122.792818:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.792826:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480122.792830:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a6ab9ba4d40) has no exports 00000004:01000000:1.0:1789480122.793000:0:15364:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789480122.793009:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d19a 00000020:00000080:1.0:1789480122.793013:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6a97c67800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.793041:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb6800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789480122.793100:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789480122.793104:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.793111:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480122.793114:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 27 (ffff8a6986983380) has no exports 00000020:00000080:1.0:1789480122.793119:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d193 00000020:00000080:1.0:1789480122.793123:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6a97c61000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.793138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c67800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:1.0:1789480122.793528:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789480122.793533:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789480122.793538:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1789480122.793543:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480122.793545:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480122.793849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c61000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789480122.793924:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.793932:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789480122.793937:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d058 00000020:00000080:1.0:1789480122.793942:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6abb3c8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.793963:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb2b6800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789480122.793970:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6ab328e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.793971:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab328e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789480122.793993:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789480122.794221:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1789480122.794225:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.794231:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480122.794234:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff8a6abb5c4d40) has no exports 00000020:00000080:1.0:1789480122.794247:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d051 00000020:00000080:1.0:1789480122.794251:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6abb5cf800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.794325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3c8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:1.0:1789480122.794866:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1789480122.794871:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789480122.794875:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1789480122.794879:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789480122.794881:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480122.794974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb5cf800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789480122.795064:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.795071:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1789480122.795083:0:15364:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789480122.795089:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ceb4 00000020:00000080:1.0:1789480122.795094:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab3289800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.795110:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb5cf000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789480122.795115:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6a866cf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.795117:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a866cf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789480122.795122:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789480122.795260:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1789480122.795265:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.795269:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789480122.795272:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a6aafaf99c0) has no exports 00000020:00000080:1.0:1789480122.795276:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cead 00000020:00000080:1.0:1789480122.795280:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6abb07c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.795298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab3289800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789480122.796392:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb07c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1789480122.804932:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1789480122.804940:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480122.804945:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1789480122.804953:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789480122.805094:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.805104:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789480122.805128:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.805130:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789480122.805135:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab98f5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789480122.805140:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab98f5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1789480122.805149:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789480122.805321:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce98 00000020:00000080:1.0:1789480122.805339:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb6000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789480122.805577:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb07d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789480122.805584:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6abb07b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789480122.805586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb07b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789480122.805590:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789480122.805985:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789480122.805997:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.806002:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789480122.806006:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff8a6ab9ba0000) has no exports 00000020:00000080:1.0:1789480122.806024:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.806028:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789480122.806032:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce9f 00000020:00000080:1.0:1789480122.806036:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb2800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.806124:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789480122.806129:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb3000/lustre-MDD0001_UUID 00000020:00000080:2.0:1789480122.806131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb3000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789480122.806134:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1789480122.806537:0:15364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6a866ce000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789480122.806541:0:15364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6a866ce000 2 00000020:01000004:1.0:1789480122.806545:0:15364:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a6a866ce000 from lustre-MDT0001 00000020:00000080:1.0:1789480122.806566:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480122.806570:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789480122.806573:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb4000/lustre-MDT0001_UUID 00000020:00000080:1.0:1789480122.806575:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb4000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789480122.806582:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789480122.806617:0:15364:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789480122.806620:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789480122.806623:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480122.806625:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00000080:2.0:1789480122.806889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00080000:1.0:1789480122.806921:0:15364:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a6abb078000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789480122.806928:0:15364:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff8a6aafafcd40) has exports, disconnecting them 00000020:00080000:1.0:1789480122.806933:0:15364:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a6abb078000), last request at 1789479861 00000020:00000080:1.0:1789480122.806937:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cef3 00000020:00080000:1.0:1789480122.806947:0:15364:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6abb078000): rc 0 00000020:00000080:1.0:1789480122.806949:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6abb078000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789480122.807217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb078000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789480122.877245:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789480122.877253:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480122.877257:0:15364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789480122.877263:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789480122.877303:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb2b1800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789480122.877471:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480122.877479:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789480122.877485:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6abb07e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789480122.877489:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb07e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789480122.877498:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789480122.877573:0:15364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6a866ce000 1 00000020:00000080:0.0:1789480122.877579:0:15364:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243ce2f 00000020:00000080:0.0:1789480122.877585:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6ab328d000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789480122.877602:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789480122.877606:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480122.877611:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789480122.877614:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a6a85e119c0) has no exports 00000020:00000080:2.0:1789480122.877651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab328d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789480122.959821:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789480122.959834:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1789480122.959839:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6a866c9800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789480122.959843:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a866c9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789480122.959921:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1789480122.960053:0:15364:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a6a866c9000 00000020:01000000:2.0:1789480122.960083:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789480122.960087:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480122.960091:0:15364:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789480122.960095:0:15364:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a6a95c9cd40) has no exports 00000100:00100000:1.0:1789480122.960352:0:6521:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a6a95c2ee00:6521] 1 exiting: rc = 0 00000100:00100000:3.0:1789480122.960551:0:8915:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a6abb49d200:8915] 3 exiting: rc = 0 00000100:00100000:3.0:1789480122.960664:0:12158:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8a6987c6a000:12158] 4 exiting: rc = 0 00000100:00100000:2.0:1789480122.960939:0:6520:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a6a95c2fc00:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1789480122.962367:0:6522:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a6a850cd200:6522] 2 exiting: rc = 0 00000100:00100000:3.0:1789480122.962614:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962624:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962707:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962714:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962720:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962726:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962731:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962738:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962743:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962749:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962755:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962760:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962765:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962771:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962776:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962782:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962787:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962792:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962797:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962803:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962809:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962814:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962819:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962837:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962843:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962911:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962921:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962926:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962932:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962939:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962943:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962949:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962954:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962961:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962966:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962971:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962976:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962992:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.962998:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963003:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963008:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963014:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963020:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963025:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963031:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963037:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963042:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963047:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963052:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963057:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963063:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963067:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963072:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963078:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963083:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963088:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963093:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963098:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963126:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963133:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963139:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963144:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963149:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.963154:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.970620:0:6524:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a6a9895e600:6524] 1 exiting: rc = 0 00000100:00100000:2.0:1789480122.970863:0:14183:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8a6ab9896200:14183] 2 exiting: rc = 0 00000100:00100000:0.0:1789480122.971034:0:6523:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a6a9895fc00:6523] 0 exiting: rc = 1 00000100:00100000:3.0:1789480122.971128:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971136:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971144:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971150:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971155:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971161:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971167:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971172:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971177:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971183:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971226:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971234:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971239:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971244:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971249:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971255:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971260:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971265:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971270:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971275:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971281:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971286:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971291:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971296:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971301:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971306:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971310:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971316:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971329:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971334:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971340:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971345:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971349:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971355:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971360:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971365:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971370:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971376:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971624:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971642:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971647:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971652:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971657:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971663:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971668:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971673:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971678:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971683:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971689:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971694:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971699:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971704:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971709:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971715:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971721:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971726:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971732:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971737:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971743:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971748:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971753:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971759:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971764:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.971777:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789480122.980043:0:6526:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a6a850cd400:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1789480122.983815:0:7836:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff8a6abb3a3400:7836] 2 exiting: rc = 0 00000100:00100000:0.0:1789480122.984042:0:6525:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a6a850cd000:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789480122.984322:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984339:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984348:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984353:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984359:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984364:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984447:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984456:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984462:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984468:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984474:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984479:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984485:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984492:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984498:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984505:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984510:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984515:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984534:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984540:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984545:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984550:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984556:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984561:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984566:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984572:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984577:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984582:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984587:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984594:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984612:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984620:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984739:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984748:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984770:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984776:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984782:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984787:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984793:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984798:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984804:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984810:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984831:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984838:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984845:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984929:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984937:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984943:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984948:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984954:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984960:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984966:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984971:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.984976:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985010:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985018:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985023:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985031:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985037:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985043:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985049:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985055:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985062:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480122.985076:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480122.999965:0:6527:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a6a88ddec00:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1789480123.000095:0:6528:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a6a88ddfc00:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1789480123.000468:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000475:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000480:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000486:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000491:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000496:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000501:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000505:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000510:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000514:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000519:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000523:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000527:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000532:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000537:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000541:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000546:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000550:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000555:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000559:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000564:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000569:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000574:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000579:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000583:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000588:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000593:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000597:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000602:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000607:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000612:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000616:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000621:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000707:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000712:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000718:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000722:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000727:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000732:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000736:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000741:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000746:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000751:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000756:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000761:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000765:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000770:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000775:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000781:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000785:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000790:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000795:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000799:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000804:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000809:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000815:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000820:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000825:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000830:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000834:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000839:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000844:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000925:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.000932:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.001783:0:6530:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a6a9f493200:6530] 1 exiting: rc = 0 00000100:00100000:1.0:1789480123.002007:0:6529:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a6a9f4a6800:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1789480123.002119:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002125:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002130:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002135:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002148:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002153:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002158:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002162:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002167:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002172:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002177:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002182:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002347:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002358:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002362:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002367:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002372:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002377:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002392:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002398:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002402:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002407:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002412:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002417:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002421:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002426:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002431:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002436:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002441:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002447:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002453:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002458:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002463:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002467:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002472:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002477:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002482:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002486:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002491:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002504:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002509:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002514:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002519:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002523:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002529:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002534:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002539:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002543:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002548:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002553:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002558:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002563:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002568:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002574:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002579:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002584:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002589:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002594:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002600:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002604:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002608:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002613:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002618:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480123.002623:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.012310:0:6531:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a6a9f4a7e00:6531] 0 exiting: rc = 1 00000100:00100000:1.0:1789480123.014325:0:6532:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a6a9f4a7000:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1789480123.014557:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014564:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014569:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014589:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014593:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014597:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014602:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014607:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014612:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014617:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014622:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014638:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014644:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014650:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014655:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014661:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014666:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014671:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014676:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014690:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014697:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014702:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014707:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014712:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014717:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014722:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014727:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014732:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014737:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014742:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014748:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014753:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014758:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014762:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014767:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014772:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014777:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014782:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014794:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014799:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014804:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014809:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014814:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014819:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014824:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014829:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014834:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014839:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014844:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014849:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014854:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014859:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014864:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014868:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014873:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014877:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014881:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014886:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014891:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014895:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014901:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014907:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014912:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.014917:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480123.015888:0:6533:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a6a9f4a7800:6533] 0 exiting: rc = 1 00000100:00100000:1.0:1789480123.016069:0:6534:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a6a9f4a6400:6534] 1 exiting: rc = 0 00000100:00100000:1.0:1789480123.016245:0:6535:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a6a9f4a7c00:6535] 2 exiting: rc = 0 00000100:00100000:3.0:1789480123.017099:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017108:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017114:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017120:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017160:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017168:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017174:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017181:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017186:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017265:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017272:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017278:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017285:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017291:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017297:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017302:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017308:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017315:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017321:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017327:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017334:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017341:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017347:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017354:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017360:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017366:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017372:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017377:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017470:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017477:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017484:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017490:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017496:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017502:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017508:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017514:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017520:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017525:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017531:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017537:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017543:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017549:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017556:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017562:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017576:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017583:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017588:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017594:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017600:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017606:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017612:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017618:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017716:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017724:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017731:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017737:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017743:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017748:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017755:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017761:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017766:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017773:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017779:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480123.017793:0:15364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789480123.032330:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480123.032343:0:15364:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789480123.032350:0:15364:0:(genops.c:885:class_export_put()) final put ffff8a6a95dd7800/MDS_uuid 00000020:00000080:3.0:1789480123.032355:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a95dd7800/MDS_uuid for MDS 00000020:01000000:3.0:1789480123.032366:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789480123.032594:0:15364:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789480123.717722:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480124.740373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480125.125392:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480125.125401:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480125.125405:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480125.125408:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480125.125412:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480125.125420:0:13097:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 488 00000100:00080000:1.0:1789480125.125426:0:13097:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789480125.125438:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a6ab98f3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480125.125475:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d5180 x1876405527951616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480125.125518:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480125.125522:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480125.125524:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480125.125527:0:13097:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 488 00000100:00080000:1.0:1789480125.125530:0:13097:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789480125.125535:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a6981c91800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480125.125546:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d6300 x1876405527951872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480125.125589:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527952000:0@lo:400:kworker.0 00000400:00000100:1.0:1789480125.125636:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952000 offset 0 length 224: 4 00000100:00100000:0.0:1789480125.125748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527951744:0@lo:400:kworker.0 00000400:00000100:0.0:1789480125.125771:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527951744 offset 0 length 224: 4 00000100:00100000:2.0:1789480125.125941:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527951616:0@lo:38:kworker.0 00000400:00000100:2.0:1789480125.125964:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527951616 offset 0 length 520: 4 00000100:00100000:2.0:1789480125.126001:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527951872:0@lo:38:kworker.0 00000400:00000100:2.0:1789480125.126016:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527951872 offset 0 length 520: 4 00010000:00010000:0.0:1789480125.766686:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480126.791249:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789480127.170778:0:15565:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000100:00080000:0.0:1789480127.173561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480127.173569:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480127.173581:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480127.173585:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789480127.173679:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527952128:0@lo:400:kworker.0 00000400:00000100:3.0:1789480127.173748:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952128 offset 0 length 224: 4 00000100:00080000:0.0:1789480127.173842:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480127.173846:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789480127.173886:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527952256:0@lo:400:kworker.0 00000400:00000100:0.0:1789480127.173912:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952256 offset 0 length 224: 4 00000020:01000004:0.0:1789480127.183732:0:15565:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789480127.183874:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.183892:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.183900:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.183907:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.183928:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789480127.183934:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1789480127.184091:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480127.184099:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.184107:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81474200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480127.184111:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.184139:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480127.184147:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480127.184153:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480127.184156:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789480127.184160:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789480127.184173:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:0.0:1789480127.184177:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.184183:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81474200/0xdaa289fda243d26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d273 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480127.184222:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480127.184224:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480127.184226:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789480127.184245:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480127.184260:0:15565:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d5180 x1876405527951616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480127.184280:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789480127.184286:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789480127.184294:0:15565:0:(import.c:65:import_set_state_nolock()) ffff8a6ab98f3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789480127.184300:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789480127.184304:0:15565:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d5180 x1876405527951616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480140 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480127.184324:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789480127.184328:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1789480127.186289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527951616:0@lo:38:kworker.0 00000100:00080000:1.0:1789480127.187396:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789480127.187537:0:15565:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d7480 x1876405527951744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480127.187572:0:15565:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6988a61880 x1876405527952128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480127.187588:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789480127.187594:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789480127.187624:0:15565:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd0800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789480127.187666:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527952384:0@lo:39:umount.0 00000400:00000100:1.0:1789480127.187730:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952384 offset 0 length 224: 4 00000100:00100000:2.0:1789480127.190936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527951744:0@lo:400:kworker.0 00000100:00100000:3.0:1789480127.191134:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527952128:0@lo:400:kworker.0 00010000:00010000:0.0:1789480127.813328:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789480128.201681:0:9515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789480128.201690:0:9515:0:(genops.c:885:class_export_put()) final put ffff8a6987a5e000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789480128.202879:0:8430:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789480128.202889:0:8430:0:(genops.c:885:class_export_put()) final put ffff8a6abb3cb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789480128.204076:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987a5e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789480128.204172:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987a5e800 for lustre-OST0001 00000020:00000080:0.0:1789480128.217811:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3cb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789480128.217913:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6abb3cf000 for lustre-OST0000 00010000:00010000:0.0:1789480128.836444:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480129.860593:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789480130.180508:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480130.180522:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480130.180525:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789480130.180528:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480130.180714:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527952512:0@lo:400:kworker.0 00000400:00000100:2.0:1789480130.180787:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952512 offset 0 length 224: 4 00010000:00010000:0.0:1789480130.884518:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480131.908466:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480132.292385:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480122/real 1789480122] req@ffff8a69888d5c00 x1876405527951488/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789480132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480132.292424:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d5c00 x1876405527951488/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789480132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480132.292447:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480132.292459:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789480132.292464:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527951488:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1789480132.292771:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480132.292777:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1789480132.292781:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789480132.292786:0:13097:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 491 00000100:00080000:0.0:1789480132.292792:0:13097:0:(import.c:630:import_select_connection()) MGC192.168.206.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789480132.292806:0:13097:0:(import.c:666:import_select_connection()) MGC192.168.206.144@tcp: import ffff8a6a95dd3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480132.292838:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988a62680 x1876405527952640/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480132.292864:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789480132.292868:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789480132.293059:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527952640:0@lo:250:kworker.0 00000400:00000100:1.0:1789480132.293114:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405527952640 offset 0 length 520: 4 00000100:00100000:3.0:1789480132.294682:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527952768:0@lo:400:kworker.0 00000400:00000100:3.0:1789480132.294756:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952768 offset 0 length 224: 4 00010000:00010000:0.0:1789480132.935392:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480133.957084:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480134.980479:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480136.004420:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480137.032805:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480137.412609:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789480137.412620:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480137.412624:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789480137.412627:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789480137.412996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527952896:0@lo:400:kworker.0 00000400:00000100:0.0:1789480137.413067:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527952896 offset 0 length 224: 4 00000100:00100000:2.0:1789480137.414666:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480127/real 1789480127] req@ffff8a69888d5180 x1876405527952384/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789480137 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480137.414713:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d5180 x1876405527952384/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789480137 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789480137.414734:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd0800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789480137.414758:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527952384:0@lo:39:umount.0 00000100:00080000:1.0:1789480137.414810:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789480137.414817:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789480137.414823:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789480137.415927:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.415944:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.415952:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.415960:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.415991:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480137.416000:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.416007:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.416014:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.416020:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480137.416068:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789480137.416074:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789480137.416103:0:15565:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789480137.416108:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789480137.416114:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480137.416121:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789480137.416125:0:15565:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a6a85e13380) has no exports 00000020:00080000:1.0:1789480137.416153:0:15565:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff8a6a85e13380) has no exports 00010000:00010000:0.0:1789480137.416883:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480137.416895:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.416914:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480137.416918:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.416929:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480137.416937:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480137.416944:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480137.416947:0:9524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789480137.416949:0:9524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789480137.416966:0:9524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:0.0:1789480137.416969:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.416976:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243d27a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d281 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.416993:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480137.416997:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.417021:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1200 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480137.417024:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.417032:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480137.417038:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480137.417043:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789480137.417045:0:9524:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789480137.417047:0:9524:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789480137.417053:0:9524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:0.0:1789480137.417056:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.417063:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243d4fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d505 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480137.417073:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480137.417074:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480137.417077:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480137.417574:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789480137.422330:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6987772480 - data ffff8a69860d85e8/ffff8a6987b68800 00000020:01000000:1.0:1789480137.422513:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6abb0ebf00 - data ffff8a6a9622b870/ffff8a6985d20c00 00100000:10000000:1.0:1789480137.431964:0:15565:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789480137.451689:0:15565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cfcc 00000020:00000080:0.0:1789480137.451702:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb4800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789480137.451726:0:15565:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789480137.451730:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8000 2 00000020:01000004:0.0:1789480137.451733:0:15565:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a6abb3b8000 from lustre-OST0000 00000020:00000080:0.0:1789480137.451756:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480137.451868:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789480137.452410:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789480137.452415:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6a97c63800/lustre-OST0000_UUID 00000020:00000080:0.0:1789480137.452418:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a97c63800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789480137.452488:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789480137.452572:0:15565:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789480137.452577:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789480137.452581:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480137.452586:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789480137.452592:0:15565:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a6ab98f5000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789480137.452597:0:15565:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff8a6ab9ba19c0) has exports, disconnecting them 00000020:00080000:0.0:1789480137.452602:0:15565:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a6ab98f5000), last request at 1789479881 00000020:00000080:0.0:1789480137.452606:0:15565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cff6 00000020:00080000:0.0:1789480137.452617:0:15565:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6ab98f5000): rc 0 00000020:00000080:0.0:1789480137.452621:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6ab98f5000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789480137.457971:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab98f5000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789480137.458017:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789480137.458021:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789480137.458026:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789480137.458032:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789480137.458054:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6ab98f3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789480137.458236:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480137.458245:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789480137.458251:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6a95dd3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789480137.458254:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a95dd3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789480137.458258:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789480137.459959:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789480137.459966:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480137.459974:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789480137.459991:0:15565:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a6986b0f000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480137.459999:0:15565:0:(genops.c:1552:class_disconnect_exports()) OBD device 20 (ffff8a69869819c0) has exports, disconnecting them 00000020:00080000:3.0:1789480137.460004:0:15565:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a6986b0f000), last request at 1789479881 00000020:00000080:3.0:1789480137.460008:0:15565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d00b 00000020:00080000:3.0:1789480137.460025:0:15565:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6986b0f000): rc 0 00000020:00000080:3.0:1789480137.460043:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6986b0f000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789480137.461570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b0f000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1789480137.463474:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789480137.463482:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789480137.463487:0:15565:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789480137.463494:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480137.463532:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6a95dd0800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789480137.463696:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480137.463704:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1789480137.463710:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6ab98f4800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789480137.463713:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab98f4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789480137.463718:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1789480137.463799:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8000 1 00000020:00000080:0.0:1789480137.463805:0:15565:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cf94 00000020:00000080:0.0:1789480137.463811:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6abb3ba800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789480137.463820:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789480137.463836:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3ba800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789480137.463846:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480137.463851:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480137.463855:0:15565:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff8a6a85e2b380) has no exports 00000020:00000080:0.0:1789480137.557618:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480137.557637:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789480137.557644:0:15565:0:(genops.c:885:class_export_put()) final put ffff8a6abb3b9800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789480137.557649:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3b9800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789480137.557960:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789480137.558179:0:15565:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a6abb3bc000 00000020:02000400:0.0:1789480137.558265:0:15565:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789480138.056170:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480139.076448:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480140.102514:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480140.485879:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480125/real 1789480125] req@ffff8a69888d6300 x1876405527951872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789480140 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480140.485916:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d6300 x1876405527951872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789480140 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480140.485930:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480140.485989:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480140.485994:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527951872:0@lo:38:kworker.0 00000100:00080000:2.0:1789480140.486036:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789480140.486041:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480140.486051:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789480140.486055:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789480140.486058:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480140.486063:0:13097:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1789480140.486068:0:13097:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789480140.486079:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a6981c91800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480140.486112:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a7bb80 x1876405527953024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480140.486161:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527953024:0@lo:38:kworker.0 00000400:00000100:0.0:1789480140.486260:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527953024 offset 0 length 520: 4 00000100:00100000:1.0:1789480140.486534:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527953152:0@lo:400:kworker.0 00000400:00000100:1.0:1789480140.486558:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527953152 offset 0 length 224: 4 00010000:00010000:0.0:1789480141.132107:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789480141.199657:0:15767:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789480141.226121:0:15767:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789480141.226283:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226303:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226312:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226321:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226347:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789480141.226371:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789480141.226404:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480141.226418:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6ac1a7bb80 x1876405527953024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.226435:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789480141.226441:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789480141.226448:0:15767:0:(import.c:65:import_set_state_nolock()) ffff8a6981c91800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789480141.226455:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480141.226459:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6ac1a7bb80 x1876405527953024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789480160 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.226466:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789480141.226469:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1789480141.226513:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480141.226520:0:9524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226528:0:9524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81475600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480141.226533:0:9524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226542:0:9524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480141.226549:0:9524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480141.226556:0:9524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789480141.226559:0:9524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789480141.226562:0:9524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789480141.226575:0:9524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:1.0:1789480141.226587:0:9524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226595:0:9524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81475600/0xdaa289fda243d250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d257 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480141.226608:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480141.226610:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480141.226612:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480141.226651:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527953024:0@lo:38:kworker.0 00000100:00080000:1.0:1789480141.230855:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789480141.230879:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d4e00 x1876405527952000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.230925:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6988a63800 x1876405527952256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480143 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.230942:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a69888d6a00 x1876405527952512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.230955:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6988a60a80 x1876405527952768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.230964:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6986a1d880 x1876405527952896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480141.232464:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527952768:0@lo:400:kworker.0 00000100:00100000:1.0:1789480141.232813:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6ac1a79c00 x1876405527953152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480156 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480141.232824:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789480141.232852:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527953152:0@lo:400:kworker.0 00000100:00100000:0.0:1789480141.232927:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527952896:0@lo:400:kworker.0 00000100:00100000:3.0:1789480141.235058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1876405527952000:0@lo:400:kworker.0 00000100:00100000:2.0:1789480141.235693:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527952512:0@lo:400:kworker.0 00000100:00100000:1.0:1789480141.237131:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527952256:0@lo:400:kworker.0 00000100:00080000:1.0:1789480141.237448:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789480141.237494:0:15767:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5c000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789480141.237532:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527953280:0@lo:39:umount.0 00000400:00000100:1.0:1789480141.237591:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876405527953280 offset 0 length 224: 4 00010000:00010000:0.0:1789480142.148456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480143.174835:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480144.196525:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480145.221982:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480145.606535:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789480145.606546:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789480146.245748:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480147.268339:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480147.396314:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480132/real 1789480132] req@ffff8a6988a62680 x1876405527952640/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789480147 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480147.396346:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6988a62680 x1876405527952640/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789480147 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480147.396368:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480147.396395:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1789480147.396400:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527952640:0@lo:250:kworker.0 00000100:00080000:3.0:1789480147.396435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6a679393-20ef-489d-b204-2797ec519e97->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789480147.396440:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789480147.396443:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480147.396449:0:36:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 501 00000100:00080000:3.0:1789480147.396454:0:36:0:(import.c:630:import_select_connection()) MGC192.168.206.144@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789480147.396466:0:36:0:(import.c:666:import_select_connection()) MGC192.168.206.144@tcp: import ffff8a6a95dd3800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480147.396501:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1f800 x1876405527953408/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480147.396596:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527953408:0@lo:250:kworker.0 00000400:00000100:1.0:1789480147.396639:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876405527953408 offset 0 length 520: 4 00010000:00010000:0.0:1789480148.295964:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480149.316425:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480150.340465:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480151.364429:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480151.493511:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480141/real 1789480141] req@ffff8a69888d5c00 x1876405527953280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789480151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480151.493545:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d5c00 x1876405527953280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789480151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480151.493568:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987a5c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789480151.493594:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527953280:0@lo:39:umount.0 00000100:00080000:2.0:1789480151.494860:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789480151.494867:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789480151.494872:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789480151.496061:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496078:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496086:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496093:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496178:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480151.496186:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496226:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496232:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480151.496239:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.502919:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480151.502937:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.502950:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81487a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480151.502955:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.502967:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480151.502974:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480151.502979:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789480151.502982:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789480151.502997:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:0.0:1789480151.503001:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.503008:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81487a00/0xdaa289fda243d25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d265 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.503027:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480151.503031:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.503056:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6aa33c6e00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480151.503058:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.503065:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480151.503072:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480151.503077:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789480151.503079:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789480151.503084:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:0.0:1789480151.503087:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480151.503094:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480151.503096:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480151.503098:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480151.510469:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480151.510485:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c6e00/0xdaa289fda243d4f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d4f7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480151.510511:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789480151.510519:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789480151.510522:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789480151.510555:0:15767:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789480151.510560:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789480151.510569:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789480151.510575:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789480151.510579:0:15767:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8a6986984d40) has no exports 00000020:00080000:2.0:1789480151.510602:0:15767:0:(genops.c:1557:class_disconnect_exports()) OBD device 24 (ffff8a6986984d40) has no exports 00000020:01000000:2.0:1789480151.519681:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a69878d15a0 - data ffff8a6a9632daf8/ffff8a6abb54ec00 00000020:01000000:2.0:1789480151.520098:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a6987abb000 - data ffff8a6a96320a20/ffff8a6abb429000 00010000:00010000:1.0:1789480151.522452:0:9524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789480151.535885:0:15767:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789480151.546802:0:15767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d0f2 00000020:00000080:3.0:1789480151.546815:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6ab3288000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789480151.546841:0:15767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6abb3b8800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789480151.546845:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8800 2 00000020:01000004:3.0:1789480151.546848:0:15767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a6abb3b8800 from lustre-OST0001 00000020:00000080:3.0:1789480151.546868:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480151.546878:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789480151.546881:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6ab9bb7800/lustre-OST0001_UUID 00000020:00000080:3.0:1789480151.546884:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab9bb7800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789480151.546889:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789480151.547001:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6a679393-20ef-489d-b204-2797ec519e97->MGS 00010000:00010000:3.0:1789480151.547019:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6a81486e00/0xdaa289fda243ce4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480151.547046:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6a81486e00/0xdaa289fda243ce4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480151.547052:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789480151.547055:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789480151.547058:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789480151.547074:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:3.0:1789480151.547078:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6a81486e00/0xdaa289fda243ce4b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243ce52 expref: -99 pid: 7450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480151.547096:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480151.547103:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480151.547108:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789480151.547111:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789480151.547112:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789480151.547123:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a6a95dd3800 00010000:00010000:3.0:1789480151.547126:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6aa33c7c00/0xdaa289fda243d2c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdaa289fda243d2c7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789480151.547142:0:15767:0:(import.c:65:import_set_state_nolock()) ffff8a6a95dd3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789480151.547146:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000020:00000080:1.0:1789480151.547147:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6ab3288000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1789480151.547149:0:15767:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789480151.547150:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789480151.547154:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789480151.547164:0:15767:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a6986a1f800 x1876405527953408/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789480167 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789480151.547214:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789480151.547217:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1789480151.547288:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6a679393-20ef-489d-b204-2797ec519e97:3644:1876405527953408:0@lo:250:kworker.0 10000000:01000000:3.0:1789480151.547422:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789480151.547430:0:15767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243cd48 00000020:00000080:3.0:1789480151.547435:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6a95dd5000/6a679393-20ef-489d-b204-2797ec519e97 00000020:01000000:3.0:1789480151.547451:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.144@tcp (flags='') 00000020:00000080:3.0:1789480151.547455:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480151.547459:0:15767:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789480151.547463:0:15767:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a6a95c999c0) has no exports 10000000:01000000:3.0:1789480151.547492:0:6517:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789480151.547533:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.144@tcp: client import never connected 00000100:00080000:3.0:1789480151.547536:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789480151.547538:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789480151.547539:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789480151.547541:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789480151.547565:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789480151.547569:0:15767:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.144@tcp (uuid 6a679393-20ef-489d-b204-2797ec519e97) 00000020:01000000:3.0:1789480151.547574:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789480151.547577:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789480151.547580:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789480151.547584:0:15767:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a6987526000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789480151.547651:0:15767:0:(genops.c:1552:class_disconnect_exports()) OBD device 25 (ffff8a698794cd40) has exports, disconnecting them 00000020:00080000:3.0:1789480151.547656:0:15767:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a6987526000), last request at 1789479907 00000020:00000080:3.0:1789480151.547660:0:15767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d11c 00000020:00080000:3.0:1789480151.547670:0:15767:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6987526000): rc 0 00000020:00000080:3.0:1789480151.547673:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6987526000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789480151.547691:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a95dd5000/6a679393-20ef-489d-b204-2797ec519e97 for MGC192.168.206.144@tcp 00000020:00000080:1.0:1789480151.547699:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6a95dd3800 for MGC192.168.206.144@tcp 00000020:00000080:1.0:1789480151.547705:0:36:0:(genops.c:885:class_export_put()) final put ffff8a6a95dd5800/6a679393-20ef-489d-b204-2797ec519e97 00000020:00000080:1.0:1789480151.547706:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6a95dd5800/6a679393-20ef-489d-b204-2797ec519e97 for MGC192.168.206.144@tcp 00000020:01000000:1.0:1789480151.547710:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.144@tcp (6a679393-20ef-489d-b204-2797ec519e97) 00000020:00000080:1.0:1789480151.548005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987526000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789480151.578638:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789480151.578647:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789480151.578652:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789480151.578660:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480151.578739:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6981c91800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789480151.578877:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789480151.578886:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789480151.578892:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6987522800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789480151.578896:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987522800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789480151.578906:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789480151.578973:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789480151.578977:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789480151.578983:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789480151.578990:0:15767:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a6987a58800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789480151.578996:0:15767:0:(genops.c:1552:class_disconnect_exports()) OBD device 26 (ffff8a698794b380) has exports, disconnecting them 00000020:00080000:1.0:1789480151.579000:0:15767:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a6987a58800), last request at 1789479907 00000020:00000080:1.0:1789480151.579004:0:15767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d131 00000020:00080000:1.0:1789480151.579018:0:15767:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a6987a58800): rc 0 00000020:00000080:1.0:1789480151.579023:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6987a58800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1789480151.579125:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987a58800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789480151.579921:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789480151.579925:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789480151.579928:0:15767:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789480151.579933:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789480151.579954:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a6987a5c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789480151.579990:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789480151.580097:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789480151.580171:0:9524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789480151.580276:0:6504:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a6a9f5a2800:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1789480151.580472:0:6503:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a6a86a2f200:6503] 0 exiting: rc = 1 00000100:00100000:0.0:1789480151.580520:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.580750:0:6506:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a6aaa3f6800:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1789480151.580866:0:9525:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a6986b7b000:9525] 3 exiting: rc = 0 00000100:00100000:0.0:1789480151.580939:0:6507:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a6a9f5f4c00:6507] 2 exiting: rc = 0 00000100:00100000:3.0:1789480151.584291:0:6505:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a6aaa3f7800:6505] 0 exiting: rc = 1 00000100:00100000:0.0:1789480151.584581:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584589:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584595:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584601:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584607:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584615:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584621:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584627:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584633:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584639:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584645:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584650:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584656:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584661:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584667:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584673:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584679:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584685:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584691:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584697:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584703:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584709:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584715:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584721:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584726:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584731:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584736:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584754:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584759:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584764:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584770:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584775:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584780:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584785:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584790:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584794:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584799:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584809:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584814:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584819:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584825:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584829:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584844:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584850:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584855:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584861:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584866:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584871:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584876:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584881:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584886:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584890:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584895:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584901:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584905:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584910:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584914:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584919:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584923:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584928:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584932:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584937:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584948:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.584953:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789480151.585655:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480151.585664:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789480151.585670:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6987526800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789480151.585674:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6987526800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789480151.585679:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789480151.585732:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6abb3b8800 1 00000020:00000080:0.0:1789480151.585739:0:15767:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xdaa289fda243d0c1 00000020:00000080:0.0:1789480151.585746:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6986b08000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789480151.585756:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789480151.585781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6986b08000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789480151.585793:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480151.585798:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480151.585802:0:15767:0:(genops.c:1557:class_disconnect_exports()) OBD device 23 (ffff8a6ac1ac3380) has no exports 00000020:00000080:0.0:1789480151.756226:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480151.756238:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789480151.756244:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6abb67a000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789480151.756248:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb67a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789480151.756255:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789480151.756747:0:15767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a6abb679000 00000020:01000000:0.0:1789480151.756768:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789480151.756772:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789480151.756777:0:15767:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789480151.756781:0:15767:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a6a85e28000) has no exports 00000020:00000080:0.0:1789480151.756808:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789480151.756813:0:15767:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789480151.756816:0:15767:0:(genops.c:885:class_export_put()) final put ffff8a6abb3bd800/OSS_uuid 00000020:00000080:0.0:1789480151.756818:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8a6abb3bd800/OSS_uuid for OSS 00000020:01000000:0.0:1789480151.756822:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789480151.756901:0:8435:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a6a88dde800:8435] 1 exiting: rc = 0 00000100:00100000:0.0:1789480151.756984:0:8436:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a6abb1b8400:8436] 2 exiting: rc = 0 00000100:00080000:3.0:1789480151.757100:0:6516:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789480151.757223:0:8493:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a6985dbb000:8493] 3 exiting: rc = 0 00000100:00100000:3.0:1789480151.757275:0:8434:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a6aafb04a00:8434] 0 exiting: rc = 1 00000100:00100000:0.0:1789480151.757459:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757467:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757473:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757479:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757554:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757561:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757566:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757570:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757576:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757581:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757585:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757590:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757594:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757599:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757603:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757608:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757614:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757620:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757625:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757630:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757635:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757640:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757645:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757650:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757761:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757768:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757773:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757778:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757782:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757786:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757791:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757795:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757800:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757805:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757809:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757822:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757827:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757843:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757848:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757853:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757858:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757862:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757873:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757879:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757884:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757889:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757893:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757897:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757902:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757907:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757911:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757915:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757920:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757925:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757930:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757934:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757938:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757943:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757948:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757952:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757957:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757962:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757967:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.757977:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480151.759020:0:8439:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a6abb34c600:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1789480151.759105:0:8438:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a6ab9901c00:8438] 0 exiting: rc = 1 00000100:00100000:1.0:1789480151.759429:0:10515:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a6987ee9400:10515] 2 exiting: rc = 0 00000100:00100000:0.0:1789480151.759612:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759622:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759629:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759635:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759640:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759646:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759802:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759807:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759813:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759818:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759824:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759829:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759845:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759851:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759857:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759862:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759868:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759874:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759879:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759884:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759889:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759896:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759901:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759906:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759912:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759917:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759923:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759928:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759933:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759938:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759943:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759949:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759955:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759961:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759966:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759971:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759977:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759982:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759988:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759993:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.759998:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760011:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760017:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760022:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760028:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760033:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760039:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760045:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760050:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760055:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760060:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760065:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760071:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760076:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760081:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760087:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760091:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760097:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760102:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760107:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760112:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760117:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760122:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.760127:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789480151.761351:0:8441:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a6a88ddf200:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1789480151.761363:0:8442:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a6ab9aafa00:8442] 2 exiting: rc = 0 00000100:00100000:3.0:1789480151.761551:0:8440:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a6ab9aae600:8440] 0 exiting: rc = 1 00000100:00100000:1.0:1789480151.763647:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763670:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763677:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763682:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763688:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763695:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763701:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763706:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763712:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763717:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763722:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763728:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763733:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763739:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763744:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763749:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763754:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763760:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763765:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763777:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763783:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763788:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763793:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.763799:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765587:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765604:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765618:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765628:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765639:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765668:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765676:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765681:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765687:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765693:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765698:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765704:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765720:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765726:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765732:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765738:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765743:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765749:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765754:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765760:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.765765:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767036:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767042:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767047:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767054:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767059:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767065:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767072:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767078:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767085:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767091:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767097:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767113:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767119:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767124:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767130:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767136:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767140:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767146:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.767152:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789480151.773066:0:8443:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a6ab9aaf800:8443] 0 exiting: rc = 1 00000100:00100000:3.0:1789480151.773155:0:8444:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a6ab9aaee00:8444] 1 exiting: rc = 0 00000100:00100000:1.0:1789480151.773285:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773292:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773298:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773303:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773308:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773313:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773318:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773335:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773340:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773345:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773350:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773356:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773361:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773366:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773371:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773377:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773382:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773387:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773392:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773398:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773403:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773409:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773414:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773432:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773438:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773443:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773448:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773454:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773459:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773464:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773469:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773474:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773479:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773485:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773491:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773497:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773503:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773508:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773514:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773519:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773523:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773528:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773541:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773572:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773578:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773583:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773588:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773593:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773598:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773604:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773609:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773614:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773618:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773623:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773628:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773633:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773638:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773643:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773648:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773667:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773673:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773678:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773683:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.773692:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774415:0:8446:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a6a8a745800:8446] 1 exiting: rc = 0 00000100:00100000:3.0:1789480151.774630:0:8445:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a6a8a745200:8445] 0 exiting: rc = 1 00000100:00100000:1.0:1789480151.774784:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774790:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774796:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774801:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774807:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774829:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774848:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774856:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774862:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774868:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774874:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774880:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774895:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774900:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774907:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774915:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774921:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774943:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774950:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774956:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774963:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774970:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774976:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774984:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774991:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.774997:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775003:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775009:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775015:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775037:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775045:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775052:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775058:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775064:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775071:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775078:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775084:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775090:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775096:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775103:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775110:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775130:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775138:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775145:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775151:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775158:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775164:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775176:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775183:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775261:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775269:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775277:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775285:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775307:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775314:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775321:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775327:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775334:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775341:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775347:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775354:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775360:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775366:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789480151.775382:0:15767:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789480151.787624:0:15767:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789480169.821136:0:16532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789480179.769065:0:17131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789480179.769071:0:17131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789480179.769073:0:17131:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789480179.769555:0:17131:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a6988485000 00000020:01000004:2.0:1789480179.769580:0:17131:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789480179.769589:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789480179.769605:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a6986983380) 00000020:00000080:2.0:1789480179.769620:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789480179.824597:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.825669:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789480179.828096:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789480179.828772:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.829009:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789480179.829612:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.829863:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.830120:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789480179.830465:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789480179.831296:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789480179.831583:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.831814:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.832274:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789480179.833541:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789480179.833816:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.834516:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.836059:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.836687:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.836984:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.837280:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.837513:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.837787:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.838403:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.839699:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.840077:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.842439:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.843046:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.843375:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.843655:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.844131:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.844585:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.844847:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.845262:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.845536:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789480179.845792:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789480179.846713:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.847533:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.847812:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.848026:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.848435:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.848728:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.848941:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.849217:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.849838:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.850066:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.851297:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.851995:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789480179.856513:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.857650:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789480179.857866:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1789480179.860339:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1789480179.860577:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1789480179.861151:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1789480179.862110:0:17131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789480179.862465:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789480179.862472:0:17131:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789480179.862482:0:17131:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e2f7 00000020:01000004:2.0:1789480179.862489:0:17131:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789480179.862494:0:17131:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789480179.862510:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6988485000 from MGS 00000020:01000004:2.0:1789480179.862513:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789480179.862523:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a6986980000) 00000020:00000080:2.0:1789480179.862533:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789480179.862701:0:17131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6988485000 from MGS, refs=2 00080000:01000000:2.0:1789480179.862707:0:17131:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789480179.862712:0:17131:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e305 00000100:00100000:2.0:1789480179.862801:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789480179.863427:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789480179.863433:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789480179.863918:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789480179.863927:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789480179.865768:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480179.866167:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789480179.866174:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789480179.869285:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789480179.869298:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789480179.871955:0:17131:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789480179.871971:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789480179.873430:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480179.873436:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480179.873438:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480179.873787:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480179.873790:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480179.873792:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480179.877640:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789480179.880321:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1789480179.885891:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789480179.893974:0:17144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789480179.894109:0:17131:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789480179.894152:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789480179.895406:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789480179.899959:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480179.900425:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789480179.900433:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789480179.901363:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789480179.901372:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789480179.901983:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789480179.901990:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789480179.904404:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789480179.904426:0:17131:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.144@tcp' 00000020:01000004:0.0:1789480179.904428:0:17131:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789480179.904482:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.144@tcp (typ=mgc) 00000020:00000080:0.0:1789480179.904496:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.144@tcp (ffff8a698794b380) 00000020:00000080:0.0:1789480179.904520:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789480179.904602:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987c3f000@MGC192.168.206.144@tcp: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789480179.904773:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.144@tcp-0 is initialized 00000040:01000000:0.0:1789480179.904786:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789480179.906145:0:17149:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:1.0:1789480179.907134:0:17148:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789480179.907161:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.144@tcp (uuid 51483ccc-9e15-472d-aee3-1dbbbf4be94f) 00000020:00000080:0.0:1789480179.907184:0:17131:0:(genops.c:1384:class_connect()) connect: client 51483ccc-9e15-472d-aee3-1dbbbf4be94f, cookie 0xdaa289fda243e313 00000100:00080000:0.0:1789480179.907212:0:17131:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480179.907224:0:17131:0:(import.c:666:import_select_connection()) MGC192.168.206.144@tcp: import ffff8a6987c3f000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480179.907259:0:17131:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988a62300 x1876405527953536/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480179.907284:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 51483ccc-9e15-472d-aee3-1dbbbf4be94f->MGS 00000020:01000004:0.0:1789480179.907307:0:17131:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789480179.907312:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:1.0:1789480179.907331:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3644:1876405527953536:0@lo:250:mount.lustre.0 00000020:00000080:0.0:1789480179.907337:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a6987948000) 00000020:00000080:0.0:1789480179.907351:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789480179.907401:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480179.911438:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527953536 00000100:00100000:1.0:1789480179.911454:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527953536 00000100:00100000:1.0:1789480179.911509:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480179.911517:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1876405527953536:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789480179.911547:0:17145:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 51483ccc-9e15-472d-aee3-1dbbbf4be94f@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:1.0:1789480179.911576:0:17145:0:(genops.c:1384:class_connect()) connect: client 51483ccc-9e15-472d-aee3-1dbbbf4be94f, cookie 0xdaa289fda243e321 00000100:00080000:1.0:1789480179.911745:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8a698849d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480179.911914:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+5:3644:x1876405527953536:12345-0@lo:250:mount.lustre.0 Request processed in 396us (4512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480179.911923:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480179.911976:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789480179.911986:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.144@tcp: connect to target with instance 0 00000100:00080000:1.0:1789480179.911994:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789480179.911998:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789480179.912002:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987c3f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789480179.912004:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789480179.912015:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789480179.912020:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3644:1876405527953536:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789480179.915859:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789480179.916058:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789480179.916065:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789480179.926776:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789480179.926791:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789480179.927355:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789480179.927362:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789480179.930277:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480179.930471:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789480179.930478:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789480179.933988:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789480179.934636:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789480179.969273:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480179.969498:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789480179.969505:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789480179.970553:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789480179.970562:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789480179.971113:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480179.971443:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480179.971448:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789480179.971926:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480179.971932:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789480179.972495:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480179.972632:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480179.972638:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789480179.973022:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480179.973028:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789480179.973626:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480179.973771:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789480179.973776:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789480179.977828:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789480179.977841:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789480180.002935:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480180.003168:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789480180.003175:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789480180.009808:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789480180.009830:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789480180.011382:0:17131:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789480180.011393:0:17131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789480180.013187:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789480180.013244:0:17131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1789480180.013251:0:17131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789480180.013354:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789480180.013385:0:17131:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789480180.013389:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789480180.013391:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480180.013392:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480180.013394:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480180.013395:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480180.013396:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480180.013398:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480180.013399:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480180.013401:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480180.013402:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789480180.013405:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789480180.013407:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789480180.013408:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480180.013409:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480180.013410:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480180.013411:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480180.013412:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480180.013413:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480180.013415:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480180.013416:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480180.013416:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789480180.013446:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789480180.013465:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789480180.013530:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.014743:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527953664 00000100:00100000:3.0:1789480180.014755:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527953664 00000100:00100000:2.0:1789480180.014786:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.014848:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480180.014859:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+5:17131:x1876405527953664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789480180.014923:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789480180.014927:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789480180.014929:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789480180.017016:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789480180.017735:0:17147:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1789480180.019529:0:17169:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789480180.019536:0:17169:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1789480180.019539:0:17169:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789480180.019541:0:17169:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789480180.019802:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789480180.019998:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789480180.020010:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789480180.021728:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+5:17131:x1876405527953664:12345-0@lo:253:mount.lustre.0 Request processed in 6860us (8186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.021741:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480180.021780:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789480180.021797:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789480180.021800:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789480180.021802:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480180.021803:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480180.021805:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480180.021815:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480180.021817:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480180.021823:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480180.021825:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480180.021826:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480180.021828:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789480180.021850:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6988485000 from lustre-MDT0000 10000000:01000000:2.0:1789480180.021880:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789480180.021883:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789480180.021887:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a698794b380 10000000:01000000:2.0:1789480180.021891:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480180.021900:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a698794b380 from 1 10000000:01000000:2.0:1789480180.021902:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789480180.021951:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.021968:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.021981:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.022014:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480180.022052:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.022095:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789480180.022109:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527953792 00000100:00100000:1.0:1789480180.022118:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527953792 00000100:00100000:1.0:1789480180.022162:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480180.022171:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+5:17131:x1876405527953792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480180.022185:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480180.022232:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243e32f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e328 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.022259:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243e32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e328 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.022277:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bcc00/0xdaa289fda243e32f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e328 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480180.022289:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bcc00, rc 0) 00000100:00100000:1.0:1789480180.022332:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+6:17131:x1876405527953792:12345-0@lo:101:mount.lustre.0 Request processed in 161us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.022338:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480180.022415:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.022428:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.022438:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.022514:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.022540:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.022568:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.022622:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527953920 00000100:00100000:3.0:1789480180.022626:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527953920 00000100:00100000:3.0:1789480180.022652:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480180.022658:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+6:17131:x1876405527953920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480180.022743:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+6:17131:x1876405527953920:12345-0@lo:501:mount.lustre.0 Request processed in 85us (201us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789480180.022757:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480180.023026:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527953920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789480180.023057:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789480180.023116:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.023125:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480180.023132:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6988485000 10000000:01000000:0.0:1789480180.023143:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789480180.023147:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a6988485000 10000000:01000000:0.0:1789480180.023149:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789480180.023152:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a6988485000 from 1 10000000:01000000:0.0:1789480180.023154:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789480180.023177:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.023183:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.023222:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480180.023236:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480180.023267:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.023288:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa26ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.023802:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954048 00000100:00100000:2.0:1789480180.023810:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954048 00000100:00100000:2.0:1789480180.023852:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480180.023860:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+6:17131:x1876405527954048:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.023876:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480180.023890:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243e33d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e336 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.023945:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243e33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e336 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.023958:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1800/0xdaa289fda243e33d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e336 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.023968:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1800, rc 0) 00000100:00100000:0.0:1789480180.024052:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480180.024061:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+7:17131:x1876405527954048:12345-0@lo:101:mount.lustre.0 Request processed in 157us (748us total) trans 0 rc 0/0 00010000:00010000:0.0:1789480180.024067:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e33d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.024075:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e33d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480180.024090:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789480180.024107:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e33d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.024115:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dbe00/0xdaa289fda243e336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e33d expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.024130:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1789480180.024130:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789480180.024133:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789480180.024138:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a6988485000 10000000:01000000:0.0:1789480180.024140:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789480180.024142:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789480180.024144:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789480180.024162:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.024170:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.024178:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480180.024223:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480180.024252:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.024270:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa26ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.024319:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954176 00000100:00100000:2.0:1789480180.024323:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954176 00000100:00100000:2.0:1789480180.024354:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480180.024361:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+7:17131:x1876405527954176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.024367:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480180.024380:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0200/0xdaa289fda243e34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e344 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.024394:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0200/0xdaa289fda243e34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e344 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.024403:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0200/0xdaa289fda243e34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e344 expref: 8 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.024409:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0200, rc 0) 00000100:00100000:2.0:1789480180.024465:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+8:17131:x1876405527954176:12345-0@lo:101:mount.lustre.0 Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.024470:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480180.024471:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789480180.024480:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e34b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.024487:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e34b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480180.024533:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480180.024557:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.024584:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa26ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.024597:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954304 00000100:00100000:2.0:1789480180.024601:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954304 00000100:00100000:2.0:1789480180.024626:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480180.024632:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+8:17131:x1876405527954304:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.025224:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17131:x1876405527954304:12345-0@lo:501:mount.lustre.0 Request processed in 591us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.025232:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480180.025632:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480180.025668:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480180.025813:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.025843:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa26ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.025957:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954432 00000100:00100000:2.0:1789480180.025962:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954432 00000100:00100000:2.0:1789480180.026003:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480180.026011:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17131:x1876405527954432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480180.030657:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17131:x1876405527954432:12345-0@lo:503:mount.lustre.0 Request processed in 4638us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.030673:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789480180.030881:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527954432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480180.031986:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17170:1876405527954560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480180.032055:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.032098:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa26c600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.032218:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954560 00000100:00100000:2.0:1789480180.032234:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954560 00000100:00100000:2.0:1789480180.032289:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480180.032298:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17170:x1876405527954560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.034261:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17170:x1876405527954560:12345-0@lo:502:llog_process_th.0 Request processed in 1956us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.034274:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789480180.035114:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17170:1876405527954560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789480180.035154:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480180.035166:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.035168:0:17170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789480180.035173:0:17170:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789480180.035176:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480180.035204:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a69879499c0) 00000020:00000080:0.0:1789480180.035221:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789480180.035227:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789480180.035325:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789480180.035336:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e359 00000020:00000080:0.0:1789480180.035536:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789480180.035541:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480180.035545:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.035547:0:17170:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789480180.035550:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480180.035553:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.035554:0:17170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789480180.035557:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480180.035572:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a698794cd40) 00000020:00000080:0.0:1789480180.035583:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789480180.035588:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789480180.035589:0:17170:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789480180.035592:0:17170:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789480180.035597:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789480180.035737:0:17170:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6988485000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789480180.035749:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a6a95c999c0) 00000020:00000080:0.0:1789480180.035756:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789480180.035818:0:17170:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789480180.035823:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e36e 00000020:00000080:0.0:1789480180.036096:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789480180.036103:0:17170:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789480180.036108:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdaa289fda243e375 00080000:01000000:0.0:1789480180.036113:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789480180.036117:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e37c 00010000:00010000:3.0:1789480180.131117:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789480180.132432:0:17170:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789480180.133642:0:17170:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789480180.134398:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a6ac1ac0000) 00000020:00000080:3.0:1789480180.134418:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789480180.134496:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789480180.134504:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e38a 00000020:00000080:2.0:1789480180.135534:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789480180.141120:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdaa289fda243e391 00000020:00000080:0.0:1789480180.142636:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789480180.142649:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480180.142655:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.142657:0:17170:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789480180.142660:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789480180.142663:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1789480180.142664:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480180.142666:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480180.142668:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789480180.142670:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.142672:0:17170:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789480180.142674:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480180.142679:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.142680:0:17170:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789480180.142684:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789480180.142739:0:17170:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789480180.142757:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480180.142760:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.142770:0:17170:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789480180.142774:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480180.142777:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.142778:0:17170:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789480180.142782:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789480180.142787:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:0.0:1789480180.142818:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480180.142835:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a6a95c9cd40) 00000020:00000080:0.0:1789480180.142853:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789480180.142870:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789480180.142929:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789480180.142935:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789480180.142942:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e39f 00010000:00080000:0.0:1789480180.142975:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6a897b2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789480180.144663:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789480180.147055:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789480180.147167:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789480180.147331:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789480180.147352:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e3a6 00000100:00080000:0.0:1789480180.147361:0:17170:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480180.147373:0:17170:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a6a897b2000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480180.147433:0:17170:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988a62a00 x1876405527954688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480180.147462:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789480180.147517:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480180.147522:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.147524:0:17170:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789480180.147527:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789480180.147530:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789480180.147532:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480180.147533:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480180.147536:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789480180.147545:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.147546:0:17170:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789480180.147550:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480180.147554:0:17170:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789480180.147558:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480180.147559:0:17170:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789480180.147562:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789480180.147565:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:0.0:1789480180.147584:0:17170:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789480180.147586:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480180.147596:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a6a95c9b380) 00000020:00000080:0.0:1789480180.147606:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789480180.147609:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789480180.147657:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789480180.147662:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789480180.147666:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e3b4 00010000:00080000:0.0:1789480180.147704:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6a97c49000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789480180.147919:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1789480180.147967:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480180.147982:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527954816:0@lo:400:kworker.0 00000100:00100000:1.0:1789480180.148044:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.148251:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527954688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789480180.148251:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954816 00000100:00100000:2.0:1789480180.148262:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954816 00000100:00100000:3.0:1789480180.148295:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.148311:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480180.148322:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:3645:x1876405527954816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480180.148359:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527954688 00000100:00100000:3.0:1789480180.148364:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527954688 00000100:00100000:2.0:1789480180.148385:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:3645:x1876405527954816:12345-0@lo:400:kworker.0 Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.148391:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480180.148394:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789480180.148400:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876405527954688:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789480180.148416:0:17157:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789480180.148614:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527954816:0@lo:400:kworker.0 00000040:01000000:0.0:1789480180.163277:0:17170:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789480180.163678:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789480180.170959:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480180.172353:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789480180.185185:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789480180.188436:0:17176:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480180.188442:0:17176:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789480180.189356:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480180.189368:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789480180.189406:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789480180.189730:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e3bb 00000100:00080000:1.0:1789480180.189742:0:17170:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480180.189752:0:17170:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a6a97c49000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480180.189791:0:17170:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d6d80 x1876405527954944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480180.189871:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527954944:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789480180.189921:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527954944 offset 0 length 520: 4 00000100:00080000:1.0:1789480180.189984:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789480180.190050:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480180.190062:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.190064:0:17170:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789480180.190068:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789480180.190071:0:17170:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789480180.190072:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480180.190074:0:17170:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480180.190076:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789480180.190078:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.190080:0:17170:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789480180.190082:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789480180.190087:0:17170:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789480180.190090:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.190092:0:17170:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789480180.190095:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789480180.190099:0:17170:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:1.0:1789480180.190119:0:17170:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789480180.190122:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480180.190135:0:17170:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a6abb5c3380) 00000020:00000080:1.0:1789480180.190148:0:17170:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789480180.190153:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789480180.190240:0:17170:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789480180.190246:0:17170:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789480180.190254:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdaa289fda243e3c9 00010000:00080000:1.0:1789480180.190293:0:17170:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6a8bea8800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1789480180.190518:0:17170:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789480180.190612:0:17170:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789480180.190628:0:17170:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789480180.193352:0:17170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789480180.194234:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876405527954688:12345-0@lo:38:llog_process_th.0 Request processed in 45828us (45933us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789480180.194266:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1789480180.195296:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789480180.195493:0:17170:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789480180.198352:0:17178:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480180.198358:0:17178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789480180.199333:0:17170:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789480180.199351:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789480180.199389:0:17170:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789480180.199409:0:17170:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e3d0 00000100:00080000:1.0:1789480180.199611:0:17170:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480180.199624:0:17170:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a6a8bea8800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480180.199667:0:17170:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d5c00 x1876405527955072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480180.199683:0:17170:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789480180.199747:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480180.199752:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.199753:0:17170:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789480180.199756:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480180.199760:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.199761:0:17170:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789480180.199764:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789480180.199766:0:17170:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789480180.199769:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480180.199771:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.199772:0:17170:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789480180.199774:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480180.199776:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.199777:0:17170:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789480180.199781:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789480180.199817:0:17170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17170:1876405527955200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480180.200076:0:17170:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.200127:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955200 00000100:00100000:1.0:1789480180.200127:0:17170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8a617480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.200138:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955200 00000100:00100000:3.0:1789480180.200218:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480180.200231:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17170:x1876405527955200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480180.200648:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17170:x1876405527955200:12345-0@lo:502:llog_process_th.0 Request processed in 419us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.200657:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480180.200744:0:17170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17170:1876405527955200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789480180.200769:0:17170:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480180.200774:0:17170:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480180.200776:0:17170:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789480180.200784:0:17170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:2.0:1789480180.201015:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480180.201020:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480180.201024:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527954688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789480180.201043:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527955072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789480180.201071:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527955072 offset 0 length 520: 4 00000020:01000000:0.0:1789480180.201342:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789480180.201367:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789480180.201532:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e34b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.201553:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db400/0xdaa289fda243e344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e34b expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480180.201562:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6988485000 from 1 10000000:01000000:0.0:1789480180.201564:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480180.201594:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.201602:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.201612:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480180.201627:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955328:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480180.201656:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480180.201684:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987dcf000 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.203744:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955328 00000100:00100000:3.0:1789480180.203760:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955328 00000100:00100000:3.0:1789480180.203816:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480180.203827:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+9:17131:x1876405527955328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480180.203846:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480180.203872:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e3d7 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.203917:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.203930:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 10 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.203940:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecca00, rc 0) 00000100:00100000:3.0:1789480180.204032:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+10:17131:x1876405527955328:12345-0@lo:101:mount.lustre.0 Request processed in 207us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.204038:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789480180.204152:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.204183:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.204220:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.204863:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955456:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789480180.204914:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.204962:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480180.204966:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955456 00000100:00100000:1.0:1789480180.204974:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955456 00000100:00100000:1.0:1789480180.205014:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480180.205023:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+10:17131:x1876405527955456:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789480180.205040:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789480180.205047:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789480180.205119:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+10:17131:x1876405527955456:12345-0@lo:256:mount.lustre.0 Request processed in 97us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.205127:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789480180.205508:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955456:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789480180.206738:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789480180.206762:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.206775:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480180.206784:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6988485000 from 1 10000000:01000000:2.0:1789480180.206786:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480180.206827:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.206835:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.206847:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.206870:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480180.206927:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.206968:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.207154:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955584 00000100:00100000:3.0:1789480180.207164:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955584 00000100:00100000:3.0:1789480180.207229:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480180.207239:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+10:17131:x1876405527955584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480180.207255:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480180.207270:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e3e5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.207293:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.207311:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.207320:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987eccc00, rc 0) 00000100:00100000:3.0:1789480180.207366:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527955584:12345-0@lo:101:mount.lustre.0 Request processed in 129us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.207373:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789480180.207534:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.207611:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.207619:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.207713:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.207745:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.207818:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480180.208314:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955712 00000100:00100000:0.0:1789480180.208321:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955712 00000100:00100000:0.0:1789480180.208393:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789480180.208403:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527955712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480180.208629:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527955712:12345-0@lo:501:mount.lustre.0 Request processed in 227us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.208637:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480180.208731:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.208771:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480180.208817:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.208968:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.209217:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955840 00000100:00100000:3.0:1789480180.209224:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955840 00000100:00100000:0.0:1789480180.209284:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480180.209292:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527955840:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480180.209388:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527955840:12345-0@lo:503:mount.lustre.0 Request processed in 96us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.209396:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789480180.209472:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527955840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480180.209731:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17180:1876405527955968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.209771:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.209965:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08780 going to sleep for 11 seconds 00000100:00100000:1.0:1789480180.210025:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527955968 00000100:00100000:1.0:1789480180.210032:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527955968 00000100:00100000:1.0:1789480180.210057:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789480180.210064:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17180:x1876405527955968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789480180.210764:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17180:x1876405527955968:12345-0@lo:502:llog_process_th.0 Request processed in 698us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480180.210774:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789480180.210860:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17180:1876405527955968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480180.210891:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480180.210900:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.210903:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789480180.210910:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6988485000 00000020:00000080:3.0:1789480180.210912:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480180.210920:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480180.210923:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.210924:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789480180.210927:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480180.210929:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.210930:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789480180.210934:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6988485000 00000020:00000080:3.0:1789480180.210936:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480180.210990:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480180.210994:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.210995:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789480180.210997:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480180.210999:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.211000:0:17180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480180.211003:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6988485000 00000020:00000080:3.0:1789480180.211005:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480180.217347:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480180.217357:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.217360:0:17180:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480180.217363:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480180.217367:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.217369:0:17180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789480180.217374:0:17180:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6988485000 00000020:00000080:3.0:1789480180.217376:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789480180.217468:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17180:1876405527956096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480180.217582:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.217629:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956096 00000100:00100000:3.0:1789480180.217637:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956096 00000100:00100000:3.0:1789480180.218668:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480180.218680:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17180:x1876405527956096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480180.218829:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17180:x1876405527956096:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.218838:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480180.218893:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.218916:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17180:1876405527956096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789480180.218944:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480180.218950:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480180.218952:0:17180:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789480180.218956:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789480180.227033:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789480180.227075:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480180.227112:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227125:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480180.227178:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789480180.227204:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6988485000 10000000:01000000:2.0:1789480180.227207:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6988485000 10000000:01000000:2.0:1789480180.227221:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480180.227228:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6988485000 from 1 10000000:01000000:2.0:1789480180.227230:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789480180.227272:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227281:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.227293:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.227522:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480180.227862:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.227902:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.228275:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956224 00000100:00100000:2.0:1789480180.228284:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956224 00000100:00100000:2.0:1789480180.228331:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480180.228342:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527956224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.228370:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480180.228386:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243e3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e3f3 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.228413:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243e3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e3f3 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.228425:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c0c00/0xdaa289fda243e3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e3f3 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.228448:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0c00, rc 0) 00000100:00100000:2.0:1789480180.228492:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527956224:12345-0@lo:101:mount.lustre.0 Request processed in 152us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.228499:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480180.228552:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480180.228569:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3fa expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.228578:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e3fa expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.228641:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.228670:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.228705:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08840 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.228731:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956352 00000100:00100000:2.0:1789480180.228736:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956352 00000100:00100000:2.0:1789480180.229142:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789480180.229153:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527956352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480180.230214:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527956352:12345-0@lo:501:mount.lustre.0 Request processed in 1059us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.230227:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789480180.230262:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480180.230315:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480180.230368:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.230452:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861a9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789480180.243906:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956480 00000100:00100000:0.0:1789480180.243923:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956480 00000100:00100000:0.0:1789480180.243985:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789480180.243997:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527956480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480180.244173:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527956480:12345-0@lo:503:mount.lustre.0 Request processed in 177us (13804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.244181:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789480180.244643:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527956480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480180.244964:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.245029:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.245061:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956608 00000100:00100000:2.0:1789480180.245066:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956608 00000100:00100000:2.0:1789480180.245107:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789480180.245116:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.245266:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956608:12345-0@lo:502:llog_process_th.0 Request processed in 150us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.245275:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789480180.245327:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08240 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.245343:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956608:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789480180.245402:0:17186:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789480180.245418:0:17186:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a6986984d40) 00000020:00000080:2.0:1789480180.245439:0:17186:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789480180.245534:0:17186:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6988485000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789480180.245538:0:17186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6988485000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789480180.245540:0:17186:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6988485000 4 00010000:00080000:2.0:1789480180.245583:0:17186:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987e11000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789480180.247251:0:17186:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789480180.247452:0:17186:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789480180.247494:0:17186:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789480180.247509:0:17186:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdaa289fda243e408 00000100:00080000:2.0:1789480180.247520:0:17186:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789480180.247531:0:17186:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a6987e11000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480180.247571:0:17186:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a7b100 x1876405527956736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480180.247604:0:17186:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789480180.247651:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527956736:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480180.247734:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480180.247843:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956736 00000100:00100000:1.0:1789480180.247853:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956736 00000100:00100000:1.0:1789480180.247924:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480180.247933:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527956736:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789480180.247995:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527956736:12345-0@lo:38:llog_process_th.0 Request processed in 61us (261us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789480180.248003:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480180.253904:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.253991:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.254022:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08600 going to sleep for 11 seconds 00000100:00100000:1.0:1789480180.255261:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789480180.255272:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e11000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480180.255277:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789480180.255282:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527956736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789480180.255286:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956864 00000100:00100000:0.0:1789480180.255296:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956864 00000100:00100000:0.0:1789480180.255386:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789480180.255397:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789480180.255547:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956864:12345-0@lo:502:llog_process_th.0 Request processed in 152us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.255556:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480180.256451:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.256527:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789480180.256575:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.256909:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527956992 00000100:00100000:3.0:1789480180.256916:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527956992 00000100:00100000:3.0:1789480180.256951:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480180.256960:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789480180.257091:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17186:x1876405527956992:12345-0@lo:502:llog_process_th.0 Request processed in 131us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.257098:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480180.261666:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480180.261722:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17186:1876405527956992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789480180.261764:0:17186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789480180.261841:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789480180.261863:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789480180.261879:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3fa expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.261891:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1200/0xdaa289fda243e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e3fa expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789480180.261938:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789480180.261940:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480180.261942:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480180.261943:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480180.261945:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480180.261946:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480180.261947:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480180.261949:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480180.261950:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480180.261952:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480180.261956:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789480180.261958:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789480180.261960:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789480180.261961:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789480180.261962:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789480180.261963:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789480180.261965:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789480180.261965:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789480180.261966:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789480180.261967:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789480180.261974:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789480180.261998:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789480180.262017:0:17131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527957120:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789480180.262079:0:17131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.262111:0:17131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480180.262397:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957120 00000100:00100000:3.0:1789480180.262405:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957120 00000100:00100000:3.0:1789480180.262496:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480180.262508:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17131:x1876405527957120:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789480180.262615:0:17146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789480180.262629:0:17146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789480180.269895:0:17146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789480180.269918:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789480180.270614:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789480180.270620:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789480180.270644:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.270663:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.270671:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.270727:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.270742:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 12 pid: 17147 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.270757:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527957248:0@lo:104: 00000100:00100000:2.0:1789480180.270820:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480180.273390:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c089c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480180.273601:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957248 00000100:00100000:0.0:1789480180.273612:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957248 00000100:00100000:0.0:1789480180.273680:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480180.273700:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527957248:12345-0@lo:104: 00010000:00010000:0.0:1789480180.273720:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480180.273800:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789480180.273807:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527957248:12345-0@lo:104: Request processed in 119us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480180.273828:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480180.273965:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527957248:0@lo:104: 00010000:00010000:2.0:1789480180.273988:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274006:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480180.274012:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274026:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:2.0:1789480180.274030:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274038:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789480180.274045:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480180.274051:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789480180.274097:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274105:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789480180.274127:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274133:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db600/0xdaa289fda243e3d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3de expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.274151:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.274153:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480180.274154:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480180.274218:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527957376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480180.274254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480180.274542:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957376 00000100:00100000:3.0:1789480180.274551:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957376 00010000:00010000:3.0:1789480180.274586:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 13 pid: 17147 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480180.274633:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480180.274645:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+13:3647:x1876405527957376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480180.274659:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480180.274666:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 13 pid: 17147 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274679:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 13 pid: 17147 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274705:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987ecca00/0xdaa289fda243e3de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e3d7 expref: 13 pid: 17147 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274720:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274741:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789480180.274756:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004136871s 00010000:00010000:3.0:1789480180.274761:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274768:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274775:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274782:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274788:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1e00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480180.274793:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274801:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274821:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480180.274831:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480180.274866:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:3647:x1876405527957376:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480180.274873:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789480180.274963:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.275045:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480180.275055:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e40f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480180.275091:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527957376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789480180.275292:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17131:x1876405527957120:12345-0@lo:253:mount.lustre.0 Request processed in 12786us (13213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480180.275301:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789480180.275489:0:17131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17131:1876405527957120:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480180.275501:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789480180.275504:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480180.275506:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789480180.275507:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480180.275508:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480180.275586:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480180.275587:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480180.275588:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789480180.275590:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789480180.275592:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480180.275593:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789480180.275605:0:17131:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1789480180.309803:0:17131:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789480180.310660:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789480180.310715:0:17191:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789480180.310720:0:17191:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789480180.311779:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789480180.311967:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789480180.312776:0:17193:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a69888d5500 x1876405527957504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480180.312789:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000040:00080000:1.0:1789480180.313160:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789480180.314971:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789480180.315025:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480180.317543:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789480180.317650:0:17192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:2.0:1789480180.319819:0:17131:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789480180.320072:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789480180.320219:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480180.321594:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789480180.322422:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789480180.322478:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789480180.326545:0:17131:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1789480180.331084:0:17131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789480180.335814:0:17131:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789480180.335858:0:17131:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c0c01cab988 00100000:10000000:3.0:1789480180.335868:0:17131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789480180.339919:0:17131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789480180.339938:0:17131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789480180.339956:0:17131:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789480180.339983:0:17131:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789480180.340919:0:17131:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480180.341132:0:17131:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789480180.933370:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789480181.124269:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480181.124276:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6988485000 from 7 10000000:01000000:0.0:1789480181.124280:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480181.124329:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480181.124342:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480181.124355:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480181.124384:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527957632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480181.124461:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480181.124514:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa33b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480181.124628:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957632 00000100:00100000:2.0:1789480181.124637:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957632 00000100:00100000:2.0:1789480181.124704:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789480181.124714:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+11:17149:x1876405527957632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480181.124730:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480181.124747:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e416 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480181.124804:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e416 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480181.124819:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e416 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480181.124829:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1000, rc 0) 00000100:00100000:3.0:1789480181.124880:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17149:x1876405527957632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480181.124887:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789480181.124972:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527957632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480181.124989:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480181.125008:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480181.125060:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527957760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789480181.125642:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480181.125676:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86826d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480181.125699:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957760 00000100:00100000:3.0:1789480181.125706:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957760 00000100:00100000:3.0:1789480181.125743:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789480181.125750:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17149:x1876405527957760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789480181.125766:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789480181.125781:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789480181.125784:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789480181.125857:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17149:x1876405527957760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480181.125865:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789480181.126328:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527957760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789480181.126384:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789480181.126395:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480181.126409:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789480181.254381:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480181.316316:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:2.0:1789480181.956648:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480182.278025:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480182.340972:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:1.0:1789480182.982751:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480183.365252:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:2.0:1789480184.004327:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789480184.071935:0:17436:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789480184.388770:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000020:00000004:0.0:1789480184.898684:0:17488:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480184.898970:0:17488:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789480185.031674:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480185.415693:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000100:00100000:3.0:1789480185.540731:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789480185.540757:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789480185.540763:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789480185.540767:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480185.540777:0:13097:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:1.0:1789480185.540784:0:13097:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789480185.540798:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a6a897b2000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480185.540825:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d7100 x1876405527958016/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480185.540873:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480185.540877:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480185.540880:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480185.540884:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480185.540887:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789480185.540891:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789480185.540893:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6987e11000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480185.540901:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a6987e11000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480185.540916:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d4a80 x1876405527958144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480185.541008:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958016:0@lo:38:kworker.0 00000100:00100000:0.0:1789480185.542800:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480185.542873:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527958144:0@lo:38:kworker.0 00000100:00100000:0.0:1789480185.542922:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480185.543621:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958016 00000100:00100000:2.0:1789480185.543639:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958016 00000100:00100000:2.0:1789480185.543709:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480185.543718:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527958016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789480185.543744:0:17158:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789480185.544856:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527957888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480185.544991:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480185.545068:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957888 00000100:00100000:3.0:1789480185.545075:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957888 00000100:00100000:3.0:1789480185.545120:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789480185.545123:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958144 00000100:00100000:3.0:1789480185.545129:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:3647:x1876405527957888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480185.545129:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958144 00000100:00100000:1.0:1789480185.545150:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480185.545154:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527958144:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789480185.545175:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000100:00100000:3.0:1789480185.545181:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:3647:x1876405527957888:12345-0@lo:400:kworker.0 Request processed in 53us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480185.545205:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:1.0:1789480185.545239:0:17154:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdaa289fda243e424 00000004:00100000:1.0:1789480185.545255:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789480185.545359:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527957888:0@lo:400:kworker.0 00000100:00080000:1.0:1789480185.545420:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6a83cff800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480185.547603:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876405527958144:12345-0@lo:38:kworker.0 Request processed in 2434us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480185.547620:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789480185.548158:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a69888d4a80 x1876405527958144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480185.548181:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789480185.548212:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789480185.548219:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789480185.548223:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e11000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789480185.548231:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876405527958144:0@lo:38:kworker.0 00000100:00100000:2.0:1789480185.568722:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527958016:12345-0@lo:38:kworker.0 Request processed in 24992us (25917us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789480185.568739:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789480185.568973:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480185.568980:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789480185.569005:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958016:0@lo:38:kworker.0 00000020:00000004:1.0:1789480185.758955:0:17538:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789480185.759120:0:17538:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789480186.052395:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480186.437844:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789480187.077772:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480187.461870:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:0.0:1789480188.104526:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480188.487246:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:2.0:1789480189.126690:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480189.510596:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789480190.149521:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480190.532346:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000100:00100000:2.0:1789480190.660413:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480180/real 1789480180] req@ffff8a69888d5c00 x1876405527955072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480190.660446:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d5c00 x1876405527955072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480190.660456:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480180/real 1789480180] req@ffff8a69888d6d80 x1876405527954944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480190 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480190.660490:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a69888d6d80 x1876405527954944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480190 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789480190.660510:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480190.660535:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789480190.660539:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527955072:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789480190.660545:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480190.660551:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789480190.660554:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527954944:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789480190.660670:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789480190.660674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789480190.660677:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480190.660683:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 554 00000100:00080000:3.0:1789480190.660687:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789480190.660697:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a6a897b2000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480190.660720:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1ea00 x1876405527958400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789480190.660747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480190.660750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789480190.660752:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480190.660755:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1789480190.660758:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789480190.660763:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a6a97c49000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480190.660778:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1e680 x1876405527958528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789480190.660785:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480190.660788:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789480190.660789:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480190.660792:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:3.0:1789480190.660794:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789480190.660798:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a6a8bea8800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480190.660808:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1e300 x1876405527958656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480190.660842:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527958784:0@lo:400:kworker.0 00000100:00100000:3.0:1789480190.660903:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480190.660948:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480190.660954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527958272:0@lo:400:kworker.0 00000100:00100000:3.0:1789480190.660983:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480190.661021:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958784 00000100:00100000:3.0:1789480190.661029:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958784 00000100:00100000:3.0:1789480190.661087:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480190.661103:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527958784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480190.661157:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527958784:12345-0@lo:400:kworker.0 Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480190.661164:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480190.661226:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958272 00000100:00100000:3.0:1789480190.661231:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958272 00000100:00100000:3.0:1789480190.661260:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480190.661267:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:3646:x1876405527958272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480190.661297:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:3646:x1876405527958272:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480190.661303:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480190.661350:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527958272:0@lo:400:kworker.0 00010000:00080000:3.0:1789480190.661363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a6986a1dc00 x1876405527958784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480190.661374:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527958784:0@lo:400:kworker.0 00000100:00100000:3.0:1789480190.661394:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958400:0@lo:38:kworker.0 00000100:00100000:3.0:1789480190.661418:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480190.661440:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958528:0@lo:8:kworker.0 00000400:00000100:3.0:1789480190.661460:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527958528 offset 0 length 520: 4 00000100:00100000:3.0:1789480190.661477:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958656:0@lo:8:kworker.0 00000400:00000100:3.0:1789480190.661493:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527958656 offset 0 length 520: 4 00000100:00100000:3.0:1789480190.661515:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958400 00000100:00100000:3.0:1789480190.661518:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958400 00000100:00100000:3.0:1789480190.661537:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480190.661550:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876405527958400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789480190.661568:0:17157:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789480190.678672:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1876405527958400:12345-0@lo:38:kworker.0 Request processed in 17113us (17243us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789480190.678688:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789480190.684680:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480190.684692:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480190.684697:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958400:0@lo:38:kworker.0 00010000:00010000:3.0:1789480191.172505:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480191.558760:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789480192.200321:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789480192.427178:0:17883:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789480192.427182:0:17883:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789480192.427184:0:17883:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789480192.428283:0:17883:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a698885a800 00000020:01000004:3.0:1789480192.428301:0:17883:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1789480192.428313:0:17883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789480192.428327:0:17883:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a6ac1ac19c0) 00000020:00000080:3.0:1789480192.428343:0:17883:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789480192.482023:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789480192.483184:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.485786:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.486052:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.486876:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.487279:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.487700:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.487997:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.488364:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.488854:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.489060:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.489525:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.489954:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.490274:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.490573:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.490977:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.491268:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.491581:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.491973:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.492291:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.492683:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.492993:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.493429:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.493906:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.494224:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.494547:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.494926:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.495237:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.495469:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.495906:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.496244:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.496700:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.497034:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789480192.497470:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789480192.498145:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.499252:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.499774:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.500180:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789480192.500436:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.500896:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789480192.501146:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.501561:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789480192.502041:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789480192.502377:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789480192.502828:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789480192.503067:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:0.0:1789480192.507054:0:17883:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789480192.507325:0:17883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789480192.507336:0:17883:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789480192.507350:0:17883:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e432 00000020:01000004:0.0:1789480192.507358:0:17883:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789480192.507381:0:17883:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789480192.507386:0:17883:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789480192.507406:0:17883:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789480192.507434:0:17883:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789480192.507438:0:17883:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1789480192.514421:0:17883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789480192.514564:0:17883:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1789480192.514569:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789480192.514572:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.514573:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.514574:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.514575:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.514576:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.514578:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.514579:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.514581:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480192.514584:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1789480192.514586:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480192.514587:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.514589:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.514589:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.514590:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.514591:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.514592:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.514680:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.514681:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480192.514785:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789480192.514808:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527958912:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480192.514879:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.514997:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.515045:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527958912 00000100:00100000:3.0:1789480192.515055:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527958912 00000100:00100000:2.0:1789480192.515326:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789480192.515340:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17883:x1876405527958912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480192.515375:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789480192.515378:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789480192.515394:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789480192.516006:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17883:x1876405527958912:12345-0@lo:253:mount.lustre.0 Request processed in 667us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.516016:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789480192.516097:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527958912:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480192.516110:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789480192.516112:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480192.516114:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.516115:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.516117:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.516127:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.516128:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.516130:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.516131:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.516132:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789480192.516153:0:17883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a698885a800 from lustre-MDT0001 10000000:01000000:1.0:1789480192.516182:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789480192.516185:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789480192.516514:0:17883:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a698794b380 local copy 00010000:00010000:1.0:1789480192.516527:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.516777:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.516819:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.516906:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.516944:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959040 00000100:00100000:3.0:1789480192.516950:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959040 00000100:00100000:3.0:1789480192.517033:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789480192.517043:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17883:x1876405527959040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480192.517131:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17883:x1876405527959040:12345-0@lo:501:mount.lustre.0 Request processed in 89us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789480192.517139:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789480192.517226:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959040:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789480192.517243:0:17883:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789480192.517261:0:17883:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789480192.517268:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.517278:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.517303:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a698885a800 10000000:01000000:1.0:1789480192.517308:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789480192.517312:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a698794b380 10000000:01000000:1.0:1789480192.517314:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789480192.517318:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a698794b380 from 1 10000000:01000000:1.0:1789480192.517321:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789480192.517348:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.517366:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.517377:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.517403:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480192.517431:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789480192.518089:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480192.518913:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.518982:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959168 00000100:00100000:0.0:1789480192.518992:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959168 00000100:00100000:0.0:1789480192.519036:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789480192.519057:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+12:17883:x1876405527959168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480192.519074:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480192.519108:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5db600/0xdaa289fda243e440 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e439 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.519138:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5db600/0xdaa289fda243e440 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e439 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.519150:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5db600/0xdaa289fda243e440 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e439 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.519159:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db600, rc 0) 00000100:00100000:0.0:1789480192.519263:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+13:17883:x1876405527959168:12345-0@lo:101:mount.lustre.0 Request processed in 208us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.519269:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789480192.519441:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480192.519471:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e440 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.519482:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e440 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.519504:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789480192.519525:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e440 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.519534:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd800/0xdaa289fda243e439 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e440 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.519544:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a698885a800 10000000:01000000:1.0:1789480192.519549:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789480192.519553:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a698885a800 from 1 10000000:01000000:1.0:1789480192.519556:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789480192.519588:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.519850:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.519860:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.519880:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959296:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480192.519924:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.519948:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.520015:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959296 00000100:00100000:0.0:1789480192.520022:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959296 00000100:00100000:0.0:1789480192.520051:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789480192.520059:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+13:17883:x1876405527959296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480192.520069:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480192.520083:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243e44e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e447 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520116:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243e44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e447 expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520126:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5db200/0xdaa289fda243e44e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e447 expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520145:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db200, rc 0) 00000100:00100000:0.0:1789480192.520221:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+14:17883:x1876405527959296:12345-0@lo:101:mount.lustre.0 Request processed in 130us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.520228:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480192.520379:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959296:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480192.520406:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e44e expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.520414:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e44e expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.520430:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789480192.520446:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e44e expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.520461:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd000/0xdaa289fda243e447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e44e expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.520467:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789480192.520471:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480192.520476:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a698885a800 10000000:01000000:1.0:1789480192.520484:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789480192.520487:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789480192.520489:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789480192.520510:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.520518:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.520525:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.520537:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480192.520565:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.520585:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.520879:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959424 00000100:00100000:0.0:1789480192.520885:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959424 00000100:00100000:0.0:1789480192.520908:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480192.520915:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+14:17883:x1876405527959424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480192.520923:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480192.520932:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5dbc00/0xdaa289fda243e45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e455 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520947:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5dbc00/0xdaa289fda243e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e455 expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520956:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5dbc00/0xdaa289fda243e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e455 expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.520962:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5dbc00, rc 0) 00000100:00100000:0.0:1789480192.521005:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959424:12345-0@lo:101:mount.lustre.0 Request processed in 91us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.521011:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789480192.521615:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480192.521642:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e45c expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.521651:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e45c expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480192.523165:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:1.0:1789480192.525669:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480192.529995:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789480192.530060:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789480192.530078:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789480192.530094:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789480192.530109:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1789480192.530123:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1789480192.530150:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1789480192.530166:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789480192.530180:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1789480192.530859:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1789480192.530883:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1789480192.530899:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1789480192.530915:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1789480192.530931:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1789480192.530946:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789480192.530960:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789480192.530977:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789480192.530993:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789480192.531009:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789480192.531025:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789480192.531040:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789480192.531056:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789480192.531073:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789480192.531105:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789480192.531113:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789480192.531330:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.531524:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.531605:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.531652:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959552 00000100:00100000:0.0:1789480192.531661:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959552 00000100:00100000:0.0:1789480192.531826:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789480192.531836:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480192.531985:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959552:12345-0@lo:501:mount.lustre.0 Request processed in 150us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.532003:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789480192.532076:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.532111:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480192.532153:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.532322:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.532563:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959680 00000100:00100000:3.0:1789480192.532570:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959680 00000100:00100000:3.0:1789480192.532600:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789480192.532608:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959680:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480192.533845:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959680:12345-0@lo:503:mount.lustre.0 Request processed in 1231us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.533865:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789480192.533974:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789480192.534565:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480192.534654:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.534709:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.534735:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.534862:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959808 00000100:00100000:3.0:1789480192.534869:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959808 00000100:00100000:3.0:1789480192.534898:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789480192.534906:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.535648:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959808:12345-0@lo:502:mount.lustre.0 Request processed in 740us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.535657:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789480192.535830:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.536036:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789480192.536070:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:1.0:1789480192.536084:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:1.0:1789480192.536095:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:1.0:1789480192.536107:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:1.0:1789480192.536119:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:1.0:1789480192.536130:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:1.0:1789480192.536142:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:1.0:1789480192.536155:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:1.0:1789480192.536167:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:1.0:1789480192.536181:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:1.0:1789480192.536237:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:1.0:1789480192.536256:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:1.0:1789480192.536270:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:1.0:1789480192.536283:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:1.0:1789480192.536296:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:1.0:1789480192.536311:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:1.0:1789480192.536326:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:1.0:1789480192.536342:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:1.0:1789480192.536356:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:1.0:1789480192.536370:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:1.0:1789480192.536788:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:1.0:1789480192.536811:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:1.0:1789480192.536826:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:1.0:1789480192.536841:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:1.0:1789480192.536857:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:1.0:1789480192.536872:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:1.0:1789480192.536885:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:1.0:1789480192.536913:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:1.0:1789480192.536926:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:1.0:1789480192.536937:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:1.0:1789480192.536948:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:1.0:1789480192.536959:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:1.0:1789480192.536970:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:1.0:1789480192.536982:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:1.0:1789480192.536993:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:1.0:1789480192.537004:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:1.0:1789480192.537015:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:1.0:1789480192.537026:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:1.0:1789480192.537038:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:1.0:1789480192.537049:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:1.0:1789480192.537061:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:1.0:1789480192.537074:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:1.0:1789480192.537093:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:1.0:1789480192.537134:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.537238:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.537270:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.537367:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527959936 00000100:00100000:0.0:1789480192.537374:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527959936 00000100:00100000:0.0:1789480192.537437:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789480192.537448:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480192.537570:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527959936:12345-0@lo:502:mount.lustre.0 Request processed in 123us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.537578:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789480192.537833:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527959936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.537885:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1789480192.537894:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789480192.538968:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480192.538983:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480192.538986:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789480192.538992:0:17887:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789480192.538996:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480192.539013:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a6abb5c0000) 00000020:00000080:1.0:1789480192.539037:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789480192.539042:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789480192.539126:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789480192.539140:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e46a 00000020:00000080:1.0:1789480192.539779:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789480192.539786:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480192.539791:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480192.539793:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789480192.539796:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480192.539799:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480192.539801:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789480192.539804:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480192.539814:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a6abb5c19c0) 00000020:00000080:1.0:1789480192.539829:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789480192.539834:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789480192.539836:0:17887:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789480192.539839:0:17887:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789480192.539845:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789480192.539896:0:17887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a698885a800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789480192.539910:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a6abb5c4d40) 00000020:00000080:1.0:1789480192.539919:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789480192.540002:0:17887:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789480192.540008:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e47f 00000020:00000080:1.0:1789480192.540100:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789480192.540107:0:17887:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789480192.540111:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdaa289fda243e486 00080000:01000000:1.0:1789480192.540117:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789480192.540122:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e48d 00000100:00100000:0.0:1789480192.581257:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:2.0:1789480192.614306:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789480192.616143:0:17887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789480192.616788:0:17887:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789480192.620668:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789480192.620681:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480192.620687:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.620689:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789480192.620692:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480192.620697:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.620699:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789480192.620712:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789480192.620718:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:3.0:1789480192.620746:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480192.620763:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a6ac1ac3380) 00000020:00000080:3.0:1789480192.620794:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789480192.620800:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789480192.620874:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789480192.620880:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789480192.620886:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e49b 00010000:00080000:3.0:1789480192.620918:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987523000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789480192.625951:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1789480192.632114:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789480192.632130:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789480192.632173:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789480192.632526:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e4a2 00000100:00080000:3.0:1789480192.632538:0:17887:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480192.632550:0:17887:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a6987523000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480192.632600:0:17887:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1d500 x1876405527960064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789480192.632665:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789480192.632807:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789480192.632883:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789480192.632952:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480192.632957:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.632958:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789480192.632961:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789480192.632964:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789480192.632965:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480192.632967:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480192.632968:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789480192.632970:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.632971:0:17887:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789480192.632974:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480192.632978:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.632979:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789480192.632984:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789480192.633104:0:17887:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789480192.633124:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480192.633128:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.633129:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789480192.633132:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789480192.633134:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789480192.633135:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480192.633136:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789480192.633138:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789480192.633140:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.633142:0:17887:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789480192.633144:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789480192.633147:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789480192.633151:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480192.633152:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789480192.633155:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789480192.633165:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1789480192.633186:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789480192.633223:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789480192.633237:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a6ac1ac4d40) 00000020:00000080:3.0:1789480192.633250:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789480192.633255:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789480192.633330:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789480192.633336:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789480192.633343:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e4b0 00010000:00080000:3.0:1789480192.633374:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6aab027000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.144@tcp at head 00000100:00100000:0.0:1789480192.633561:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960064 00000100:00100000:0.0:1789480192.633570:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960064 00000100:00100000:0.0:1789480192.633607:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480192.633615:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527960064:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789480192.633653:0:17158:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:0.0:1789480192.633681:0:17158:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e4b7 00000004:00100000:0.0:1789480192.633696:0:17158:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789480192.633714:0:17158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789480192.633960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789480192.633966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789480192.633970:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480192.633975:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:1.0:1789480192.633980:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789480192.633986:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a6a897b2000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480192.634014:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d7100 x1876405527960192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1789480192.634253:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1789480192.635287:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789480192.635672:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1789480192.638622:0:17158:0:(import.c:65:import_set_state_nolock()) ffff8a6abb3bb800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1789480192.638926:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480192.639173:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789480192.639340:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1789480192.639661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.639667:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480192.639669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.639672:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789480192.639734:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480192.639750:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527960320:0@lo:400:kworker.0 00000100:00100000:1.0:1789480192.639799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.639847:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960320 00000100:00100000:1.0:1789480192.639855:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960320 00000100:00100000:1.0:1789480192.639900:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789480192.639910:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527960320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480192.639956:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527960320:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480192.639963:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789480192.640003:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a69888d5880 x1876405527960320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480192.640016:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527960320:0@lo:400:kworker.0 00000100:00100000:3.0:1789480192.640212:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527960192:0@lo:38:kworker.0 00000100:00100000:3.0:1789480192.640244:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.640308:0:17157:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789480192.640316:0:17157:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1789480192.640672:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527960064:12345-0@lo:38:llog_process_th.0 Request processed in 7056us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.640680:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480192.640696:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960192 00000100:00100000:0.0:1789480192.640767:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960192 00000100:00100000:0.0:1789480192.640788:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789480192.640793:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527960192:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789480192.640842:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1876405527960192:12345-0@lo:38:kworker.0 Request processed in 47us (596us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789480192.640858:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480192.641556:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480192.641568:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789480192.641576:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789480192.641581:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789480192.641585:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987523000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789480192.641606:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480192.641646:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480192.641650:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480192.641653:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789480192.641656:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527960192:0@lo:38:kworker.0 00000100:00100000:2.0:1789480192.641785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527960448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480192.641831:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480192.641894:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960448 00000100:00100000:3.0:1789480192.641900:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960448 00000100:00100000:3.0:1789480192.641939:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480192.641947:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1876405527960448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480192.641980:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000040:00080000:0.0:1789480192.642324:0:17892:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480192.642329:0:17892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789480192.643093:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789480192.643103:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789480192.643136:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789480192.643155:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e4be 00000100:00080000:0.0:1789480192.643162:0:17887:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480192.643171:0:17887:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a6aab027000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480192.643224:0:17887:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988a61c00 x1876405527960576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789480192.643245:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789480192.643289:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.643292:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.643294:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789480192.643297:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789480192.643299:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1789480192.643301:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480192.643302:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789480192.643304:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789480192.643306:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.643307:0:17887:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789480192.643309:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480192.643312:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789480192.643315:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.643316:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789480192.643318:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789480192.643322:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:0.0:1789480192.643342:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789480192.643344:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480192.643361:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a6a95c98000) 00000020:00000080:0.0:1789480192.643372:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789480192.643376:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789480192.643467:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789480192.643476:0:17887:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789480192.643483:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdaa289fda243e4cc 00010000:00080000:0.0:1789480192.643514:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6987e15000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1789480192.643834:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789480192.643899:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789480192.643915:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1789480192.644638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.644644:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480192.644646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.644649:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789480192.644684:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960576:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789480192.644750:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527960576 offset 0 length 520: 4 00000100:00100000:3.0:1789480192.645051:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1876405527960448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3102us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.645062:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:0.0:1789480192.646745:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789480192.647054:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789480192.647281:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789480192.647822:0:17895:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480192.647827:0:17895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789480192.648262:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527960448:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1789480192.649119:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789480192.649132:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789480192.649173:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789480192.649364:0:17887:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e4d3 00000100:00080000:0.0:1789480192.649374:0:17887:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789480192.649521:0:17887:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1789480192.649563:0:17887:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988a61180 x1876405527960704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480192.649638:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960704:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789480192.649686:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527960704 offset 0 length 520: 4 00000100:00080000:0.0:1789480192.649817:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789480192.649885:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.649889:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.649891:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789480192.649894:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.649898:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.649899:0:17887:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789480192.649902:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789480192.649915:0:17887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789480192.649918:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.649921:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.649922:0:17887:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789480192.649925:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.649927:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.649929:0:17887:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789480192.649932:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789480192.649960:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.649962:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.649964:0:17887:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789480192.649967:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789480192.650090:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789480192.650118:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789480192.650135:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e45c expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650147:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bc200/0xdaa289fda243e455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e45c expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480192.650156:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a698885a800 from 1 10000000:01000000:0.0:1789480192.650159:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480192.650231:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650241:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650254:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480192.650271:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527960832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480192.650329:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480192.650349:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.650375:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960832 00000100:00100000:0.0:1789480192.650382:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960832 00000100:00100000:0.0:1789480192.650440:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789480192.650462:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+15:17883:x1876405527960832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480192.650478:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480192.650493:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e4da expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650520:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e4da expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650531:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e4da expref: 16 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650540:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da200, rc 0) 00000100:00100000:0.0:1789480192.650577:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17883:x1876405527960832:12345-0@lo:101:mount.lustre.0 Request processed in 129us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.650584:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789480192.650642:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527960832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480192.650656:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480192.650665:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789480192.651316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480192.651322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480192.651325:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480192.651328:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789480192.652087:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527960960:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789480192.652154:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480192.652219:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab98339c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.652329:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527960960 00000100:00100000:2.0:1789480192.652338:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527960960 00000100:00100000:0.0:1789480192.652529:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789480192.652540:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17883:x1876405527960960:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789480192.652561:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789480192.652578:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789480192.652581:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789480192.652693:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17883:x1876405527960960:12345-0@lo:256:mount.lustre.0 Request processed in 154us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.652701:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480192.652854:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527960960:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789480192.657089:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789480192.657119:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.657134:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.657142:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a698885a800 from 1 10000000:01000000:1.0:1789480192.657145:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480192.657875:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.657888:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.657902:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.657932:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480192.658003:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.658053:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861c0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.658678:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961088 00000100:00100000:2.0:1789480192.658689:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961088 00000100:00100000:2.0:1789480192.658763:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480192.658775:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17883:x1876405527961088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480192.658793:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480192.658811:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e4e8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.658841:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.658873:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.658884:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1600, rc 0) 00000100:00100000:2.0:1789480192.658945:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961088:12345-0@lo:101:mount.lustre.0 Request processed in 172us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.658952:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789480192.659231:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480192.659258:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.659268:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480192.659418:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480192.659477:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.659513:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.659542:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480192.659900:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961216 00000100:00100000:0.0:1789480192.659907:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961216 00000100:00100000:0.0:1789480192.659951:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480192.659960:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480192.660067:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961216:12345-0@lo:501:mount.lustre.0 Request processed in 107us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480192.660074:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480192.660149:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.660181:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480192.660261:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.660291:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5b09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.660346:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961344 00000100:00100000:3.0:1789480192.660350:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961344 00000100:00100000:3.0:1789480192.660380:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789480192.660399:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480192.660502:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961344:12345-0@lo:503:mount.lustre.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.660509:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789480192.660716:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961344:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789480192.661056:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480192.661146:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.661186:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.661244:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.661368:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961472 00000100:00100000:3.0:1789480192.661375:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961472 00000100:00100000:3.0:1789480192.661413:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789480192.661422:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.661528:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961472:12345-0@lo:502:mount.lustre.0 Request processed in 107us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.661536:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789480192.661871:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.662058:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789480192.662085:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1789480192.662096:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1789480192.662107:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1789480192.662119:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1789480192.662130:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1789480192.662152:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1789480192.662164:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1789480192.662175:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789480192.662185:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1789480192.662534:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1789480192.662574:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.662637:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.662726:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.666877:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961600 00000100:00100000:3.0:1789480192.666896:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961600 00000100:00100000:3.0:1789480192.666972:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789480192.666984:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.667207:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961600:12345-0@lo:502:mount.lustre.0 Request processed in 204us (4548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.667216:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789480192.667357:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.667471:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1789480192.667486:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789480192.668324:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.668334:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668337:0:17897:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789480192.668344:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a698885a800 00000020:00000080:0.0:1789480192.668347:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480192.668354:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.668356:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668357:0:17897:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789480192.668360:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.668362:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668363:0:17897:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789480192.668366:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a698885a800 00000020:00000080:0.0:1789480192.668378:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480192.668478:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.668482:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668483:0:17897:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789480192.668486:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.668489:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668490:0:17897:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480192.668493:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a698885a800 00000020:00000080:0.0:1789480192.668495:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480192.668515:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.668518:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668519:0:17897:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480192.668522:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480192.668524:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668526:0:17897:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789480192.668530:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a698885a800 00000020:00000080:0.0:1789480192.668532:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480192.668556:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480192.668559:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480192.668561:0:17897:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789480192.668563:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1789480192.668894:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789480192.668923:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480192.668948:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.668961:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480192.669013:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789480192.669017:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a698885a800 10000000:01000000:1.0:1789480192.669020:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a698885a800 10000000:01000000:1.0:1789480192.669023:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480192.669029:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a698885a800 from 1 10000000:01000000:1.0:1789480192.669032:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789480192.669073:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.669083:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.669106:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480192.669131:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480192.669216:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.669253:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.669324:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961728 00000100:00100000:2.0:1789480192.669332:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961728 00000100:00100000:2.0:1789480192.669392:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789480192.669403:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17883:x1876405527961728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480192.669418:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480192.669433:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243e4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e4f6 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.669469:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243e4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e4f6 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.669481:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1c00/0xdaa289fda243e4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e4f6 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.669490:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1c00, rc 0) 00000100:00100000:2.0:1789480192.669530:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527961728:12345-0@lo:101:mount.lustre.0 Request processed in 130us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.669538:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789480192.673104:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480192.673139:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4fd expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.673154:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e4fd expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480192.675943:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789480192.676263:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480192.677575:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789480192.677620:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789480192.677652:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789480192.677667:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789480192.677681:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789480192.677693:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789480192.677811:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789480192.677830:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789480192.677844:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789480192.677857:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789480192.677869:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789480192.677903:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789480192.677919:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789480192.677931:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789480192.677954:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789480192.677967:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789480192.677979:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789480192.677991:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789480192.678003:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789480192.678015:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789480192.678026:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789480192.678038:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789480192.678050:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789480192.678063:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789480192.678073:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789480192.678084:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789480192.678097:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789480192.678122:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789480192.678148:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789480192.678153:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789480192.678281:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.678342:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.678515:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.685112:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961856 00000100:00100000:2.0:1789480192.685128:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961856 00000100:00100000:2.0:1789480192.685248:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789480192.685261:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527961856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480192.692660:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527961856:12345-0@lo:501:mount.lustre.0 Request processed in 7390us (14306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.692676:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789480192.692964:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480192.693028:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480192.693093:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.693122:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.693551:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527961984 00000100:00100000:2.0:1789480192.693561:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527961984 00000100:00100000:2.0:1789480192.694645:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789480192.694660:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527961984:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480192.694839:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527961984:12345-0@lo:503:mount.lustre.0 Request processed in 183us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.694846:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789480192.694938:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527961984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789480192.699179:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480192.699297:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.699376:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.702716:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.706801:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962112 00000100:00100000:3.0:1789480192.706815:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962112 00000100:00100000:3.0:1789480192.706873:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789480192.706884:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.707124:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962112:12345-0@lo:502:mount.lustre.0 Request processed in 241us (7746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.707133:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789480192.711850:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.712103:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789480192.712136:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789480192.712150:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789480192.712165:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789480192.712179:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789480192.712211:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789480192.712226:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789480192.712239:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789480192.712253:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789480192.712268:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789480192.712282:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789480192.712295:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789480192.712325:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789480192.712342:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789480192.712357:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789480192.712371:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789480192.712400:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789480192.712415:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789480192.712428:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789480192.712442:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789480192.713553:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789480192.713581:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789480192.713598:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789480192.713612:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789480192.713637:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789480192.713656:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789480192.713672:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789480192.713687:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789480192.714005:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789480192.714024:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789480192.714038:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789480192.714064:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789480192.714079:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789480192.714093:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789480192.714107:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789480192.714121:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789480192.714134:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789480192.714149:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789480192.714162:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789480192.714175:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789480192.714381:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789480192.714414:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789480192.714431:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789480192.714446:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789480192.714740:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789480192.714758:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789480192.714774:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789480192.714788:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789480192.714859:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.714934:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.714982:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.715175:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962240 00000100:00100000:3.0:1789480192.715183:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962240 00000100:00100000:3.0:1789480192.715268:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789480192.715279:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.715408:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962240:12345-0@lo:502:mount.lustre.0 Request processed in 131us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.715418:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789480192.715678:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.715904:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789480192.715931:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789480192.715962:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480192.716005:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.716034:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.716147:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962368 00000100:00100000:3.0:1789480192.716153:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962368 00000100:00100000:3.0:1789480192.716217:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789480192.716227:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962368:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480192.716324:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962368:12345-0@lo:502:mount.lustre.0 Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.716332:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789480192.716426:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480192.716591:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789480192.716600:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789480192.719573:0:17903:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789480192.719591:0:17903:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a6ab9ba19c0) 00000020:00000080:1.0:1789480192.719615:0:17903:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789480192.719790:0:17903:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a698885a800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789480192.719794:0:17903:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a698885a800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789480192.719797:0:17903:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a698885a800 3 00010000:00080000:1.0:1789480192.719840:0:17903:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6aab16c800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1789480192.726888:0:17903:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789480192.731302:0:17903:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789480192.731357:0:17903:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789480192.731373:0:17903:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdaa289fda243e50b 00000100:00080000:1.0:1789480192.731385:0:17903:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789480192.731399:0:17903:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a6aab16c800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480192.731444:0:17903:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d5880 x1876405527962496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480192.731708:0:17903:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789480192.731742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.731747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480192.731750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480192.731753:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789480192.732033:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527962496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480192.732120:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480192.732549:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962496 00000100:00100000:2.0:1789480192.732559:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962496 00000100:00100000:2.0:1789480192.732599:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480192.732607:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876405527962496:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789480192.732649:0:17153:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 561 last 0 00000020:00000080:2.0:1789480192.732689:0:17153:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdaa289fda243e512 00000040:00080000:0.0:1789480192.733665:0:17903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000004:00100000:2.0:1789480192.733858:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789480192.733903:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8a6ab2ff3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480192.733993:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876405527962496:12345-0@lo:38:llog_process_th.0 Request processed in 1384us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.734004:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789480192.734066:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a69888d5880 x1876405527962496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480192.734078:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789480192.734095:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789480192.734104:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789480192.734110:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789480192.734112:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6aab16c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789480192.734119:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876405527962496:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1789480192.735328:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789480192.735366:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789480192.735399:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4fd expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480192.735412:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bd200/0xdaa289fda243e4f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e4fd expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789480192.736393:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789480192.736396:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.736397:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.736399:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.736400:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.736402:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.736404:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.736406:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.736407:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480192.736411:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789480192.736414:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480192.736415:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.736416:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.736417:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.736418:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.736419:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.736420:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.736421:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.736422:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480192.736777:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789480192.736799:0:17883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962624:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480192.736869:0:17883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480192.736913:0:17883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a69874a9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480192.736940:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962624 00000100:00100000:1.0:1789480192.736949:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962624 00000100:00100000:1.0:1789480192.737003:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789480192.737014:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17883:x1876405527962624:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789480192.737051:0:17146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789480192.737064:0:17146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789480192.745128:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789480192.745769:0:17146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789480192.745786:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1789480192.746228:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789480192.746234:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789480192.746260:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746280:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e416 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746289:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e4da expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746296:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746341:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 18 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746356:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 18 pid: 17146 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480192.746370:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527962752:0@lo:104: 00000100:00100000:2.0:1789480192.746441:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480192.746598:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.746619:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 18 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480192.746658:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527962880:0@lo:104: 00000100:00100000:2.0:1789480192.746684:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480192.746881:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a897d2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789480192.747074:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962752 00000100:00100000:3.0:1789480192.747083:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962752 00000100:00100000:3.0:1789480192.747120:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527962880 00000100:00100000:3.0:1789480192.747122:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527962880 00000100:00100000:3.0:1789480192.747136:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480192.747146:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527962752:12345-0@lo:104: 00010000:00010000:3.0:1789480192.747162:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747241:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789480192.747247:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527962752:12345-0@lo:104: Request processed in 102us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.747254:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480192.747272:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480192.747277:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527962880:12345-0@lo:104: 00010000:00010000:3.0:1789480192.747283:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747314:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789480192.747318:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527962880:12345-0@lo:104: Request processed in 43us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.747323:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789480192.747350:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480192.747356:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747375:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dae00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480192.747379:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747556:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480192.747565:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480192.747571:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480192.747607:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747614:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480192.747645:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747652:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4e1 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747666:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480192.747669:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747674:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480192.747677:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747693:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480192.747700:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480192.747780:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480192.747796:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747801:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480192.747807:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747813:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e41d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.747826:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480192.747828:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480192.747829:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480192.747836:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480192.747849:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527963136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480192.747884:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480192.747909:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480192.747914:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527963008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480192.747934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480192.747963:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963136 00000100:00100000:3.0:1789480192.747968:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963136 00010000:00010000:3.0:1789480192.747996:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 19 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480192.748016:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963008 00000100:00100000:3.0:1789480192.748019:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963008 00010000:00010000:3.0:1789480192.748029:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 20 pid: 17146 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480192.748040:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480192.748046:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:3646:x1876405527963136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480192.748057:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480192.748063:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 20 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748071:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 20 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748087:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480192.748114:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:3646:x1876405527963136:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.748120:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480192.748133:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480192.748139:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:3646:x1876405527963008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480192.748146:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480192.748150:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 19 pid: 17146 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748159:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 19 pid: 17146 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748186:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748216:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789480192.748231:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004136871s 00010000:00010000:3.0:1789480192.748236:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748242:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748249:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748256:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748261:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1e00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480192.748265:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748273:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748282:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480192.748292:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480192.748317:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:3646:x1876405527963008:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480192.748329:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480192.748364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527963008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480192.748374:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527963136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480192.748904:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5da200/0xdaa289fda243e4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e4da expref: 18 pid: 17146 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480192.748918:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527962752:0@lo:104: 00010000:00010000:2.0:1789480192.748928:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1000/0xdaa289fda243e41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e416 expref: 17 pid: 17147 timeout: 661 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480192.748936:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527962880:0@lo:104: 00010000:00010000:2.0:1789480192.748972:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.748983:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.748989:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480192.748995:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e519 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480192.749092:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17883:x1876405527962624:12345-0@lo:253:mount.lustre.0 Request processed in 12080us (12222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.749111:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789480192.749238:0:17883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17883:1876405527962624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480192.749250:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789480192.749253:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480192.749259:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789480192.749261:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480192.749262:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480192.749264:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480192.749265:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480192.749266:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789480192.749268:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480192.749270:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789480192.749281:0:17883:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1789480192.762022:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789480192.762278:0:17908:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789480192.762282:0:17908:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789480192.762308:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789480192.762927:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789480192.767839:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1789480192.769317:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789480192.769414:0:17909:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789480192.769936:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963264:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789480192.770012:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480192.770041:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33300c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.770562:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963264 00000100:00100000:2.0:1789480192.770572:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963264 00000100:00100000:2.0:1789480192.770648:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480192.770660:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963264:12345-0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789480192.770950:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789480192.770997:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480192.771845:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963264:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1184us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.771857:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480192.772281:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963264:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789480192.772324:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789480192.772374:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789480192.772666:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480192.772694:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330780 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.772970:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963392 00000100:00100000:2.0:1789480192.772980:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963392 00000100:00100000:2.0:1789480192.773036:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480192.773047:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789480192.773228:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 183us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480192.773236:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480192.773283:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789480192.773358:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17910:1876405527963520:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789480192.773403:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:3.0:1789480192.773984:0:17883:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789480192.774035:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789480192.774123:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480192.774860:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a897d20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480192.774947:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963520 00000100:00100000:1.0:1789480192.774957:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963520 00000100:00100000:1.0:1789480192.775011:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789480192.775022:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17910:x1876405527963520:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789480192.775101:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17910:x1876405527963520:12345-0@lo:900:lod0001_rec0000.0 Request processed in 81us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480192.775109:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789480192.776843:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:0.0:1789480192.777911:0:17910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a6ac1a7b100 x1876405527963520/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789480208 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480192.777929:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17910:1876405527963520:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789480192.778017:0:17910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963648:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789480192.778096:0:17910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480192.778125:0:17910:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3330540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480192.778233:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963648 00000100:00100000:2.0:1789480192.778243:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963648 00000100:00100000:2.0:1789480192.778302:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480192.778313:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963648:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789480192.778435:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17910:x1876405527963648:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 123us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480192.778817:0:17910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1876405527963648:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789480192.778870:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480192.779306:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:3.0:1789480192.779819:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789480192.779874:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789480192.780059:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789480192.783361:0:17883:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1789480192.786993:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789480192.787076:0:17910:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789480192.787080:0:17910:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1789480192.788679:0:17883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789480192.791039:0:17883:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789480192.791085:0:17883:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9c0c01cbb988 00100000:10000000:2.0:1789480192.791094:0:17883:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789480192.792858:0:17883:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789480192.792890:0:17883:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789480192.792905:0:17883:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789480192.792932:0:17883:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789480192.795960:0:17883:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789480192.796240:0:17883:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789480193.223380:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480193.610990:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000040:00080000:1.0:1789480193.800007:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789480194.186558:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480194.186569:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a698885a800 from 8 10000000:01000000:0.0:1789480194.186576:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480194.186648:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.186661:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.186674:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480194.186707:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527963776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480194.186792:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.186866:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480194.187508:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963776 00000100:00100000:3.0:1789480194.187528:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963776 00000100:00100000:3.0:1789480194.187598:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789480194.187610:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17149:x1876405527963776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480194.187635:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480194.187653:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e520 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.187683:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e520 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.187693:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e520 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.187722:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc000, rc 0) 00000100:00100000:3.0:1789480194.187794:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527963776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480194.187801:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789480194.187994:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527963776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480194.188015:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.188034:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480194.188108:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527963904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480194.188146:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.188183:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2ba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480194.188388:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527963904 00000100:00100000:3.0:1789480194.188394:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527963904 00000100:00100000:3.0:1789480194.188436:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789480194.188443:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527963904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789480194.188459:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789480194.188481:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789480194.188485:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789480194.188684:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527963904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 240us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480194.188692:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789480194.188755:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527963904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480194.188806:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480194.188815:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.188823:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480194.188833:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480194.188836:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6988485000 from 8 10000000:01000000:0.0:1789480194.188839:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480194.188860:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.188867:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480194.188876:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480194.188890:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527964032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480194.188926:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480194.188960:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2ba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480194.189047:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964032 00000100:00100000:1.0:1789480194.189053:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964032 00000100:00100000:1.0:1789480194.189102:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480194.189119:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527964032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480194.189128:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480194.189140:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e52e expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.189158:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e52e expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.189167:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e52e expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480194.189174:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bce00, rc 0) 00000100:00100000:1.0:1789480194.189237:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527964032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480194.189244:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789480194.189283:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527964032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480194.189297:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.189309:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480194.189354:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527964160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789480194.189384:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480194.189415:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480194.189527:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964160 00000100:00100000:0.0:1789480194.189532:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964160 00000100:00100000:0.0:1789480194.189563:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789480194.189570:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527964160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789480194.189583:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789480194.189596:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789480194.189599:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789480194.189684:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527964160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480194.189691:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789480194.189806:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527964160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789480194.189852:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789480194.189859:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.189867:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480194.244477:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480194.629165:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000040:00080000:2.0:1789480194.825545:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789480195.275786:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480195.652271:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:1.0:1789480196.293359:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480196.680054:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00010000:00010000:3.0:1789480197.316850:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480197.701238:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 0 seconds 00000100:00080000:1.0:1789480197.829318:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789480197.829325:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789480197.829329:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789480197.829345:0:13097:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a6a897b2000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1789480197.829370:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a69888d7100 x1876405527964416/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789480197.829383:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480197.829386:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480197.829389:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480197.829398:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480197.829423:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480197.829427:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789480197.829429:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480197.829432:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789480197.829513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527964288:0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.829583:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.829646:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480197.829653:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527964544:0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.829678:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.829705:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527964800:0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.829732:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.829751:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480197.829756:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527964672:0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.829779:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.829806:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964288 00000100:00100000:1.0:1789480197.829814:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964288 00000100:00100000:1.0:1789480197.829858:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480197.829867:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:3647:x1876405527964288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.829920:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:3647:x1876405527964288:12345-0@lo:400:kworker.0 Request processed in 53us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.829927:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480197.829959:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964544 00000100:00100000:1.0:1789480197.829963:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964544 00000100:00100000:1.0:1789480197.829994:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964800 00000100:00100000:1.0:1789480197.829997:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964800 00000100:00100000:1.0:1789480197.830009:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480197.830014:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527964544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.830045:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527964544:12345-0@lo:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.830051:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789480197.830061:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480197.830081:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527964800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.830109:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527964800:12345-0@lo:400:kworker.0 Request processed in 43us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.830115:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480197.830137:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964672 00000100:00100000:1.0:1789480197.830141:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964672 00000100:00100000:1.0:1789480197.830161:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480197.830166:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527964672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.830219:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527964672:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.830225:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480197.830265:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527964672:0@lo:400:kworker.0 00010000:00080000:1.0:1789480197.830277:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a69888d4a80 x1876405527964800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480197.830286:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527964800:0@lo:400:kworker.0 00010000:00080000:1.0:1789480197.830313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a69888d6d80 x1876405527964544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480197.830321:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527964544:0@lo:400:kworker.0 00000100:00100000:1.0:1789480197.830337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527964288:0@lo:400:kworker.0 00000100:00100000:2.0:1789480197.830473:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527964416:0@lo:38:kworker.0 00000100:00100000:2.0:1789480197.830507:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.830803:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964416 00000100:00100000:1.0:1789480197.830809:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964416 00000100:00100000:0.0:1789480197.831037:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527964928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480197.831076:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.833308:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527964928 00000100:00100000:1.0:1789480197.833326:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527964928 00000100:00100000:1.0:1789480197.833387:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480197.833395:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1876405527964416:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789480197.833431:0:17893:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1789480197.833482:0:17893:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e53c 00000004:00100000:1.0:1789480197.833499:0:17893:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789480197.833505:0:17893:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789480197.833587:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480197.833596:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527964928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480197.833640:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480197.833712:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527964928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.833719:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480197.836610:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527964928:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789480197.855793:0:17893:0:(import.c:65:import_set_state_nolock()) ffff8a6aab2fe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480197.855901:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527964416:12345-0@lo:38:kworker.0 Request processed in 22504us (25391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.855912:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789480197.855988:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789480197.855998:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789480197.856004:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789480197.856006:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a897b2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789480197.856023:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003263262b): req@ffff8a69888d5500 x1876405527957504/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480197.856050:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527964416:0@lo:38:kworker.0 00000100:00100000:1.0:1789480197.856117:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.856140:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480197.856155:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527957504 00000100:00100000:1.0:1789480197.856162:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527957504 00000100:00100000:1.0:1789480197.856230:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480197.856239:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527957504:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789480197.856310:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527957504:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480197.856317:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480197.856358:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1876405527957504:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1789480197.856394:0:17193:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789480197.856740:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1876405527965056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789480197.856776:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480197.856812:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa370ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480197.856872:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965056 00000100:00100000:2.0:1789480197.856877:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965056 00000100:00100000:2.0:1789480197.856947:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789480197.856957:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527965056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789480197.857070:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527965056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480197.857075:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789480197.857934:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1876405527965056:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789480197.858034:0:17193:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1876405527965184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789480197.858078:0:17193:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480197.858149:0:17193:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789480197.858304:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965184 00000100:00100000:3.0:1789480197.858311:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965184 00000100:00100000:3.0:1789480197.858382:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480197.858392:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527965184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789480197.858487:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17193:x1876405527965184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480197.858495:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789480197.858561:0:17193:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17193:1876405527965184:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789480197.858642:0:17193:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480197.860706:0:17193:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789480197.860797:0:17193:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:2.0:1789480197.860802:0:17193:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1789480197.865785:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527965312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480197.865866:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480197.867589:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965312 00000100:00100000:0.0:1789480197.867619:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965312 00000100:00100000:0.0:1789480197.867716:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480197.867728:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527965312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789480197.869608:0:17893:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789480197.869763:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527965312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2034us (3892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480197.869776:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480197.869895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527965312:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1789480197.989502:0:18153:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789480198.340452:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789480198.820504:0:18205:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789480198.820871:0:18205:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789480199.365470:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789480200.189279:0:18255:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480200.189508:0:18255:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789480200.392156:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789480201.367556:0:18303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe78c9f580 20000000:00000080:3.0:1789480201.367578:0:18303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6ab2eac000 uarg=0000000000000000 20000000:01000000:3.0:1789480201.367659:0:18303:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789480201.367668:0:18303:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789480201.367674:0:18303:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789480201.368571:0:18304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1789480201.368774:0:18303:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789480201.376543:0:18303:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789480201.376822:0:18303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.376844:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.376853:0:18303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.376860:0:18303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.376909:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.376926:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480201.376944:0:18303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1876405527965440:0@lo:104: 00000100:00100000:2.0:1789480201.377034:0:18303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480201.377145:0:18303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.377174:0:18303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480201.377184:0:18303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1876405527965568:0@lo:104: 00000100:00100000:2.0:1789480201.377243:0:18303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480201.380322:0:18303:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480201.380681:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965440 00000100:00100000:1.0:1789480201.380693:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965440 00000100:00100000:1.0:1789480201.380750:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965568 00000100:00100000:1.0:1789480201.380753:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965568 00000100:00100000:1.0:1789480201.380773:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480201.380783:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:18303:x1876405527965440:12345-0@lo:104: 00010000:00010000:1.0:1789480201.380802:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480201.381250:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480201.381259:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:18303:x1876405527965440:12345-0@lo:104: Request processed in 477us (4226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480201.381270:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480201.381305:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789480201.381314:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:18303:x1876405527965568:12345-0@lo:104: 00010000:00010000:1.0:1789480201.381323:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381679:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480201.381689:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381698:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480201.381703:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381713:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480201.381721:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480201.381727:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789480201.381775:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381782:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480201.381812:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381819:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bda00/0xdaa289fda243e4e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e4ef expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381836:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480201.381840:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381863:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:0.0:1789480201.381866:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381874:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789480201.381881:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480201.381886:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789480201.381904:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381910:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789480201.381917:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381924:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0a00/0xdaa289fda243e3e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e3ec expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480201.381939:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480201.381941:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480201.381942:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480201.382078:0:18303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1876405527965440:0@lo:104: 00000100:00100000:2.0:1789480201.382090:0:18303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18303:1876405527965568:0@lo:104: 00010000:00010000:2.0:1789480201.382116:0:18303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480201.382176:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527965696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480201.382252:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480201.382530:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480201.382537:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527965824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789480201.382577:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789480201.382644:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789480201.382654:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:18303:x1876405527965568:12345-0@lo:104: Request processed in 1340us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480201.382663:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789480201.382762:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480201.383174:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965696 00000100:00100000:2.0:1789480201.383182:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965696 00000100:00100000:3.0:1789480201.383481:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965824 00000100:00100000:3.0:1789480201.383486:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965824 00010000:00010000:3.0:1789480201.383519:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 19 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480201.383557:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480201.383566:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:3645:x1876405527965824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480201.383589:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480201.383595:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 19 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480201.383606:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 19 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480201.383623:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987eccc00/0xdaa289fda243e3ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e3e5 expref: 19 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480201.383637:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480201.383696:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:3645:x1876405527965824:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480201.383703:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789480201.383777:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480201.383804:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480201.383811:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:3645:x1876405527965696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480201.383819:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480201.383823:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383832:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383843:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e4ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e4e8 expref: 17 pid: 17147 timeout: 670 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383870:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383878:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383895:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383904:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383911:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383918:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383924:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480201.383928:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383935:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.383951:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480201.384101:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527965824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480201.384150:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480201.384260:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:3645:x1876405527965696:12345-0@lo:103:ldlm_bl.0 Request processed in 449us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480201.384284:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789480201.384314:0:18303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.384323:0:18303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480201.384330:0:18303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0600/0xdaa289fda243e543 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480201.394905:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527965696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480201.416981:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480202.436485:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789480202.501254:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480202.501260:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a698885a800 from 13 10000000:01000000:3.0:1789480202.501265:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480202.501313:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.501326:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.501340:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480202.501369:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527965952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.501429:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.501470:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2feb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789480202.501538:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527965952 00000100:00100000:0.0:1789480202.501546:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527965952 00000100:00100000:0.0:1789480202.501605:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480202.501614:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+16:17149:x1876405527965952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480202.501628:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480202.501641:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e54a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480202.501665:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e54a expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480202.501676:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e54a expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480202.501687:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da600, rc 0) 00000100:00100000:0.0:1789480202.501728:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527965952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480202.501734:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789480202.501845:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527965952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480202.501859:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.501869:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480202.501936:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.501971:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.502495:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480202.504880:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966080 00000100:00100000:1.0:1789480202.504892:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966080 00000100:00100000:1.0:1789480202.509703:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789480202.509723:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527966080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480202.509920:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527966080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (7946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480202.512564:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.512716:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.512786:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.514064:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480202.515267:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966208 00000100:00100000:3.0:1789480202.515279:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966208 00000100:00100000:1.0:1789480202.519220:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789480202.519265:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789480202.519284:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527966208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.519448:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527966208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480202.519455:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789480202.521907:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480202.526951:0:18355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789480202.528762:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789480202.528853:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480202.528866:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.528878:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480202.528890:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789480202.528892:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6988485000 from 13 10000000:01000000:3.0:1789480202.528895:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480202.528942:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.528950:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.528963:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480202.529057:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.529138:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.529210:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480202.530091:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966336 00000100:00100000:2.0:1789480202.530101:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966336 00000100:00100000:2.0:1789480202.530167:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789480202.530177:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+17:17149:x1876405527966336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480202.530213:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480202.530230:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e558 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480202.530259:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e558 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480202.530271:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e558 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480202.530280:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:2.0:1789480202.530350:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527966336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480202.530359:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789480202.530365:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480202.530383:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480202.530394:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480202.530645:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.530675:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.530705:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480202.530923:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966464 00000100:00100000:2.0:1789480202.530933:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966464 00000100:00100000:2.0:1789480202.531136:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789480202.531148:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527966464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480202.531752:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527966464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 608us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480202.531881:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789480202.535880:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.535941:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480202.536076:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.536164:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fe600 going to sleep for 11 seconds 00000100:00100000:1.0:1789480202.536620:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966592 00000100:00100000:1.0:1789480202.536630:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966592 00000100:00100000:1.0:1789480202.536691:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480202.536701:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527966592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789480202.536958:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:17149:x1876405527966592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480202.536965:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480202.537021:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527966592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480202.560075:0:18357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789480202.560174:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789480202.560217:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480202.560230:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480202.560243:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480202.756907:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480202.948392:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480192/real 1789480192] req@ffff8a6988a61180 x1876405527960704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480202 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480202.948425:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6988a61180 x1876405527960704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480202 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480202.948437:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480192/real 1789480192] req@ffff8a6988a61c00 x1876405527960576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480202 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480202.948448:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6988a61c00 x1876405527960576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480202 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480202.948466:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480202.948490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.948506:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480202.948510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.948514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480202.948551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.948556:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480202.948559:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789480202.948563:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00080000:2.0:1789480202.948566:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00100000:1.0:1789480202.948570:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789480202.948583:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789480202.954584:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527966848:0@lo:400:kworker.0 00000100:00080000:1.0:1789480202.954598:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6aab027000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480202.954623:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789480202.954628:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527960576:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789480202.954669:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.954728:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789480202.954742:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527966720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480202.954785:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480202.954804:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527966976:0@lo:400:kworker.0 00000100:00100000:3.0:1789480202.954820:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527967232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480202.954852:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480202.954881:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966720 00000100:00100000:1.0:1789480202.954890:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480202.954892:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966720 00000100:00100000:1.0:1789480202.954900:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527967104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480202.954926:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480202.954963:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966848 00000100:00100000:1.0:1789480202.954968:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966848 00000100:00100000:3.0:1789480202.954970:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527966976 00000100:00100000:3.0:1789480202.954980:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527966976 00000100:00100000:1.0:1789480202.955006:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480202.955007:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527967104 00000100:00100000:3.0:1789480202.955012:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527967104 00000100:00100000:3.0:1789480202.955025:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789480202.955036:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527966848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480202.955037:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480202.955102:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527966848:12345-0@lo:400:kworker.0 Request processed in 87us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480202.955109:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527966720:12345-0@lo:400:kworker.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480202.955113:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480202.955133:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789480202.955146:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789480202.955153:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789480202.955158:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527966976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480202.955165:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527967104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480202.955225:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789480202.955274:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527967104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480202.955281:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789480202.955431:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527966976:12345-0@lo:400:kworker.0 Request processed in 276us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480202.955439:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789480202.955668:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527967104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480202.955683:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527966976:0@lo:400:kworker.0 00000100:00100000:1.0:1789480202.955711:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789480202.955748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6ac1a78000 x1876405527966848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480202.955759:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527966848:0@lo:400:kworker.0 00000100:00100000:1.0:1789480202.955774:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527966720:0@lo:400:kworker.0 00000100:00080000:2.0:1789480202.956837:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1789480202.956844:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789480202.956854:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480202.956943:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527967232 00000100:00100000:3.0:1789480202.956952:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527967232 00000100:00100000:3.0:1789480202.956996:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789480202.957005:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527967232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480202.957035:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789480202.957171:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527967232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480202.957178:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789480202.957910:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527967232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480202.958001:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a78e00 x1876405527967360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480202.958063:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527967360:0@lo:8:kworker.0 00000400:00000100:0.0:1789480202.958142:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527967360 offset 0 length 520: 4 00000100:00100000:2.0:1789480202.958401:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527967488:0@lo:400:kworker.0 00000100:00100000:2.0:1789480202.958442:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480202.958499:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527967488 00000100:00100000:2.0:1789480202.958505:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527967488 00000100:00100000:2.0:1789480202.958565:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480202.958591:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527967488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480202.958670:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527967488:12345-0@lo:400:kworker.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480202.958680:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789480202.958734:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6ac1a79c00 x1876405527967488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480202.958746:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527967488:0@lo:400:kworker.0 00000100:00080000:2.0:1789480202.958777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.958783:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480202.958786:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.958789:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789480202.958793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480202.958796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789480202.958800:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6aab027000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480202.958806:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1789480202.958812:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789480202.958821:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a6aab027000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480202.958841:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a79c00 x1876405527967616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480202.959321:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527967616:0@lo:8:kworker.0 00000400:00000100:0.0:1789480202.959352:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527967616 offset 0 length 520: 4 00010000:00010000:2.0:1789480203.461791:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789480203.975010:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789480204.037019:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789480204.485577:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480205.001228:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480190/real 1789480190] req@ffff8a6986a1e680 x1876405527958528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480205.001259:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6986a1e680 x1876405527958528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480205.001268:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480190/real 1789480190] req@ffff8a6986a1e300 x1876405527958656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480205.001281:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6986a1e300 x1876405527958656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480205.001305:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480205.001433:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480205.001438:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958528:0@lo:8:kworker.0 00000100:00080000:0.0:1789480205.001445:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1789480205.001558:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1789480205.001742:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480205.001747:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527958656:0@lo:8:kworker.0 00000100:00100000:3.0:1789480205.001823:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527967872:0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.001890:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480205.002079:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527967744:0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.002109:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480205.002223:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527967744 00000100:00100000:1.0:1789480205.002233:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527967744 00000100:00100000:1.0:1789480205.002283:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789480205.002293:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:3646:x1876405527967744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480205.002366:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:3646:x1876405527967744:12345-0@lo:400:kworker.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480205.002374:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789480205.002522:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527967744:0@lo:400:kworker.0 00000100:00080000:2.0:1789480205.002771:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480205.002776:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789480205.002781:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480205.002786:0:13097:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1789480205.002791:0:13097:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789480205.002798:0:13097:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a6a97c49000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480205.002828:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a7a300 x1876405527968000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789480205.002881:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527968000:0@lo:8:kworker.0 00000400:00000100:1.0:1789480205.002916:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527968000 offset 0 length 520: 4 00000100:00080000:2.0:1789480205.002960:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480205.002964:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480205.002966:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480205.002969:0:13097:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1789480205.002972:0:13097:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789480205.002978:0:13097:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a6a8bea8800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480205.002992:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1a7b100 x1876405527968128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480205.003044:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527967872 00000100:00100000:0.0:1789480205.003051:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527967872 00000100:00100000:0.0:1789480205.003089:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789480205.003098:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527967872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480205.003144:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527967872:12345-0@lo:400:kworker.0 Request processed in 48us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480205.003164:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789480205.003310:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527967872:0@lo:400:kworker.0 00000100:00100000:0.0:1789480205.003691:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527968128:0@lo:8:kworker.0 00000400:00000100:0.0:1789480205.003720:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876405527968128 offset 0 length 520: 4 00000100:00100000:2.0:1789480205.003883:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527968256:0@lo:400:kworker.0 00000100:00100000:2.0:1789480205.003924:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480205.004024:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968256 00000100:00100000:1.0:1789480205.004030:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968256 00000100:00100000:1.0:1789480205.004074:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480205.004082:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527968256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.004267:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527968384:0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.004305:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480205.004352:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968384 00000100:00100000:3.0:1789480205.004356:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968384 00000100:00100000:3.0:1789480205.004381:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480205.004387:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527968384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.004423:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527968384:12345-0@lo:400:kworker.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480205.004431:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480205.004465:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527968384:0@lo:400:kworker.0 00000100:00100000:1.0:1789480205.004614:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527968256:12345-0@lo:400:kworker.0 Request processed in 532us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480205.004621:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789480205.004757:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6988a63b80 x1876405527968256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480205.004768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527968256:0@lo:400:kworker.0 00000100:00080000:0.0:1789480205.004861:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480205.004866:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480205.004869:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480205.004872:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789480205.004926:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527968512:0@lo:400:kworker.0 00000100:00100000:1.0:1789480205.005096:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789480205.005299:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480205.005304:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480205.005306:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480205.005308:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480205.005464:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968512 00000100:00100000:2.0:1789480205.005471:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968512 00000100:00100000:3.0:1789480205.005725:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789480205.005736:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480205.005837:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527968512:12345-0@lo:400:kworker.0 Request processed in 104us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480205.005844:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789480205.005921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6988a60e00 x1876405527968512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480205.005932:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527968512:0@lo:400:kworker.0 00010000:00010000:2.0:1789480205.508876:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480206.532816:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480207.557300:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480208.068880:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480208.068903:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527968640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480208.068998:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480208.069415:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968640 00000100:00100000:1.0:1789480208.069426:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968640 00000100:00100000:1.0:1789480208.069484:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789480208.069508:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527968640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480208.069561:0:17893:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789480208.069615:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527968640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.069629:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480208.069700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527968768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480208.069747:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.069811:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527968640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480208.070146:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968768 00000100:00100000:1.0:1789480208.070152:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968768 00000100:00100000:1.0:1789480208.070187:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789480208.070222:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527968768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480208.070243:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480208.070279:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527968768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.070285:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480208.070881:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527968768:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789480208.581401:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789480208.663148:0:18652:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789480208.663152:0:18652:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789480208.663154:0:18652:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789480208.663404:0:18652:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a6aab30a800 00000020:01000004:3.0:1789480208.663419:0:18652:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789480208.663431:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789480208.663451:0:18652:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a6a83463380) 00000020:00000080:3.0:1789480208.663468:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789480208.758717:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789480208.769639:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789480208.770328:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789480208.771601:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789480208.771966:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789480208.772720:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789480208.773448:0:18652:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1789480208.779394:0:18652:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789480208.779620:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789480208.779634:0:18652:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789480208.779647:0:18652:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdaa289fda243e56d 00000020:01000004:1.0:1789480208.779655:0:18652:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789480208.779674:0:18652:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789480208.779678:0:18652:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789480208.779684:0:18652:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789480208.779699:0:18652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789480208.779710:0:18652:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a6ab9ba0000) 00000020:00000080:1.0:1789480208.779721:0:18652:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789480208.781112:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480208.791360:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789480208.791369:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789480208.801938:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789480208.801949:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789480208.802822:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789480208.802831:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789480208.809714:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789480208.809902:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789480208.809909:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789480208.811941:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789480208.811953:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789480208.833422:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789480208.833670:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789480208.833678:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789480208.843336:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789480208.843380:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789480208.844963:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789480208.844976:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789480208.849365:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789480208.849584:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789480208.849592:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789480208.851837:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789480208.851850:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789480208.910472:0:18652:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789480208.912711:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789480208.912722:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789480208.915746:0:18652:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789480208.915760:0:18652:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789480208.916621:0:18652:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789480208.916651:0:18652:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789480208.916663:0:18652:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789480208.941701:0:18652:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789480208.941762:0:18652:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789480208.941767:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789480208.941768:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480208.941770:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480208.941772:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480208.941773:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480208.941774:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480208.941776:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480208.941784:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480208.941785:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789480208.941788:0:18652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789480208.941791:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480208.941792:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480208.941793:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480208.941794:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480208.941795:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480208.941795:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480208.941796:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480208.941797:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480208.941798:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789480208.941830:0:18652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789480208.941853:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527968896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480208.941920:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480208.941977:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789480208.942125:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527968896 00000100:00100000:2.0:1789480208.942135:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527968896 00000100:00100000:2.0:1789480208.942343:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789480208.942424:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:18652:x1876405527968896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480208.942471:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789480208.942475:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789480208.942478:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789480208.943124:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:18652:x1876405527968896:12345-0@lo:253:mount.lustre.0 Request processed in 770us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480208.943134:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789480208.943261:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527968896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480208.943273:0:18652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789480208.943275:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480208.943277:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480208.943278:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480208.943279:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480208.943280:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480208.943281:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480208.943283:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480208.943284:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480208.943285:0:18652:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789480208.943305:0:18652:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6aab30a800 from lustre-OST0000 10000000:01000000:0.0:1789480208.943526:0:18652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789480208.943529:0:18652:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789480208.943537:0:18652:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a698794b380 local copy 00010000:00010000:0.0:1789480208.943560:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480208.943682:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480208.943797:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480208.943835:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480208.943847:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969024 00000100:00100000:3.0:1789480208.943855:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969024 00000100:00100000:3.0:1789480208.943901:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789480208.943911:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:18652:x1876405527969024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480208.943991:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:18652:x1876405527969024:12345-0@lo:501:mount.lustre.0 Request processed in 81us (193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789480208.943998:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789480208.944019:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789480208.944033:0:18652:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789480208.944050:0:18652:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789480208.944057:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480208.944065:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480208.944087:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6aab30a800 10000000:01000000:0.0:1789480208.944091:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789480208.944095:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789480208.944098:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789480208.944102:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789480208.944105:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789480208.944127:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480208.944135:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480208.944145:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480208.944159:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789480208.944186:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480208.944239:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c300 going to sleep for 11 seconds 00000100:00100000:2.0:1789480208.944288:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969152 00000100:00100000:2.0:1789480208.944292:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969152 00000100:00100000:2.0:1789480208.944324:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789480208.944330:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+18:18652:x1876405527969152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789480208.944412:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480208.944426:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e582 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e57b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480208.944450:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e57b expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480208.944463:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb3c1600/0xdaa289fda243e582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e57b expref: 19 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480208.944472:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1600, rc 0) 00000100:00100000:2.0:1789480208.944681:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969152:12345-0@lo:101:mount.lustre.0 Request processed in 350us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480208.944687:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789480208.944904:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480208.944919:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e582 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480208.944928:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e582 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480208.949398:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789480208.950750:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480208.954042:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789480208.954101:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789480208.954117:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789480208.954131:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789480208.954144:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789480208.954158:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789480208.954185:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789480208.954446:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789480208.954917:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969280:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480208.954983:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480208.955073:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789480208.955131:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969280 00000100:00100000:3.0:1789480208.955140:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969280 00000100:00100000:1.0:1789480208.955605:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789480208.955616:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480208.955778:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969280:12345-0@lo:501:mount.lustre.0 Request processed in 163us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.955786:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480208.955950:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480208.955993:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480208.956038:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.956171:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a990bc180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480208.956351:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969408 00000100:00100000:3.0:1789480208.956365:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969408 00000100:00100000:3.0:1789480208.956393:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789480208.956401:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480208.957383:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969408:12345-0@lo:503:mount.lustre.0 Request processed in 976us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480208.957395:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480208.957798:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480208.958617:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480208.958725:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480208.958790:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.958889:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a990bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480208.959009:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969536 00000100:00100000:1.0:1789480208.959017:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969536 00000100:00100000:1.0:1789480208.959068:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789480208.959078:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480208.960055:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969536:12345-0@lo:502:mount.lustre.0 Request processed in 972us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.960066:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789480208.960174:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480208.960677:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789480208.960709:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789480208.960724:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789480208.960738:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789480208.960750:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789480208.960761:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789480208.960773:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789480208.960785:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789480208.960798:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789480208.960812:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789480208.960824:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789480208.960853:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789480208.960894:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480208.960946:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.960999:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a990bc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480208.961075:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969664 00000100:00100000:1.0:1789480208.961084:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969664 00000100:00100000:1.0:1789480208.961128:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789480208.961137:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480208.961275:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969664:12345-0@lo:502:mount.lustre.0 Request processed in 137us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.961282:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789480208.961641:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480208.961699:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789480208.961709:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1789480208.962783:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789480208.962792:0:18669:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1789480208.962798:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.962800:0:18669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789480208.962806:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789480208.962822:0:18669:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a6ab9ba3380) 00000020:00000080:1.0:1789480208.962845:0:18669:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789480208.962851:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789480208.962937:0:18669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab30a800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789480208.962945:0:18669:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789480208.962961:0:18669:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdaa289fda243e590 00010000:00010000:1.0:1789480208.968698:0:18669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1789480208.969117:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1789480208.971096:0:18669:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1789480208.972924:0:18669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789480208.972944:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480208.972950:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.972953:0:18669:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789480208.972956:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789480208.972959:0:18669:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789480208.972960:0:18669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480208.972962:0:18669:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789480208.972963:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789480208.972966:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.972967:0:18669:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789480208.972970:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480208.972973:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.972974:0:18669:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789480208.972977:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789480208.972979:0:18669:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789480208.972981:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480208.972984:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.972985:0:18669:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789480208.972987:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480208.972989:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.972990:0:18669:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789480208.972992:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789480208.973021:0:18669:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480208.973023:0:18669:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480208.973024:0:18669:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789480208.973027:0:18669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789480208.973217:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789480208.973440:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789480208.973578:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e582 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.973592:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dae00/0xdaa289fda243e57b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e582 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480208.973600:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6aab30a800 from 1 10000000:01000000:3.0:1789480208.973602:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480208.973646:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.973660:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.973672:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480208.973697:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480208.973756:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480208.973797:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480208.973880:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969792 00000100:00100000:1.0:1789480208.973889:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969792 00000100:00100000:1.0:1789480208.973939:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789480208.973949:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:18652:x1876405527969792:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480208.973964:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480208.973978:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e597 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480208.974016:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e597 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480208.974028:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e597 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480208.974037:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bdc00, rc 0) 00000100:00100000:1.0:1789480208.974076:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527969792:12345-0@lo:101:mount.lustre.0 Request processed in 129us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480208.974083:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789480208.975379:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480208.975406:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.975418:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480208.977570:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789480208.977869:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480208.978082:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789480208.978108:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789480208.978123:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789480208.978128:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789480208.980630:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480208.980703:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480208.982387:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480208.984664:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527969920 00000100:00100000:0.0:1789480208.984678:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527969920 00000100:00100000:0.0:1789480208.986336:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789480208.986350:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527969920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789480208.986539:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527969920:12345-0@lo:501:mount.lustre.0 Request processed in 193us (5835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480208.986557:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789480208.987684:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527969920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480208.987748:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480208.987822:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480208.987898:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480208.987971:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970048 00000100:00100000:0.0:1789480208.987979:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970048 00000100:00100000:0.0:1789480208.988019:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789480208.988028:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970048:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480208.988152:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970048:12345-0@lo:503:mount.lustre.0 Request processed in 124us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480208.988160:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789480208.988759:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480208.989245:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480208.989570:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480208.989639:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.989681:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789480208.989746:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970176 00000100:00100000:0.0:1789480208.989753:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970176 00000100:00100000:0.0:1789480208.989797:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789480208.989807:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480208.989912:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970176:12345-0@lo:502:mount.lustre.0 Request processed in 106us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480208.989928:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789480208.990052:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480208.990268:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789480208.990297:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789480208.990719:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789480208.990751:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789480208.990764:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789480208.990778:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789480208.990792:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789480208.990806:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1789480208.990836:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789480208.990851:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1789480208.990862:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1789480208.990893:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480208.990941:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480208.990975:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480208.991124:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970304 00000100:00100000:0.0:1789480208.991130:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970304 00000100:00100000:0.0:1789480208.991170:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789480208.991180:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480208.991317:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970304:12345-0@lo:502:mount.lustre.0 Request processed in 138us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480208.991324:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789480208.991720:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480208.991777:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1789480208.991786:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789480208.993698:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480208.993710:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993712:0:18673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789480208.993720:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6aab30a800 00000020:00000080:3.0:1789480208.993723:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480208.993731:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480208.993733:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993735:0:18673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789480208.993737:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480208.993740:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993741:0:18673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789480208.993744:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6aab30a800 00000020:00000080:3.0:1789480208.993746:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480208.993805:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480208.993809:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993811:0:18673:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789480208.993814:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480208.993817:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993818:0:18673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480208.993822:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6aab30a800 00000020:00000080:3.0:1789480208.993824:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480208.993842:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480208.993844:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993846:0:18673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789480208.993848:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789480208.993850:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993851:0:18673:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789480208.993854:0:18673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6aab30a800 00000020:00000080:3.0:1789480208.993856:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789480208.993876:0:18673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789480208.993879:0:18673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789480208.993891:0:18673:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789480208.993895:0:18673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789480208.993953:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789480208.993983:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789480208.993998:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994010:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480208.994054:0:18652:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789480208.994057:0:18652:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6aab30a800 10000000:01000000:3.0:1789480208.994059:0:18652:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6aab30a800 10000000:01000000:3.0:1789480208.994063:0:18652:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789480208.994068:0:18652:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6aab30a800 from 1 10000000:01000000:3.0:1789480208.994070:0:18652:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789480208.994110:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994119:0:18652:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994133:0:18652:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480208.994157:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480208.994329:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480208.994432:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970432 00000100:00100000:3.0:1789480208.994440:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970432 00000100:00100000:3.0:1789480208.994632:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789480208.994644:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:18652:x1876405527970432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480208.994670:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480208.994684:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecce00/0xdaa289fda243e5ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e5a5 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994715:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecce00/0xdaa289fda243e5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e5a5 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994728:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecce00/0xdaa289fda243e5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e5a5 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994738:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecce00, rc 0) 00000100:00100000:3.0:1789480208.994778:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970432:12345-0@lo:101:mount.lustre.0 Request processed in 135us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480208.994784:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789480208.994828:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480208.994849:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480208.994865:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5ac expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480208.994874:0:18652:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e5ac expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480209.000808:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789480209.001109:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480209.001329:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789480209.001363:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789480209.001379:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789480209.001392:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789480209.001406:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789480209.001432:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789480209.001444:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789480209.001458:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789480209.001471:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789480209.003477:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789480209.003659:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789480209.003677:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789480209.003690:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789480209.005837:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789480209.005884:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789480209.005900:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789480209.005934:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789480209.005949:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789480209.005963:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789480209.005976:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789480209.005989:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789480209.006001:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789480209.006013:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789480209.006027:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789480209.006038:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789480209.006051:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789480209.006064:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789480209.006075:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789480209.006087:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789480209.006099:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789480209.006112:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789480209.006124:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789480209.006152:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789480209.006166:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789480209.006177:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789480209.006391:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789480209.006425:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789480209.006456:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789480209.006489:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789480209.006824:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480209.006891:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.007499:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480209.015852:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970560 00000100:00100000:1.0:1789480209.015867:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970560 00000100:00100000:1.0:1789480209.015923:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789480209.015933:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480209.016113:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970560:12345-0@lo:501:mount.lustre.0 Request processed in 181us (9221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480209.016121:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789480209.016405:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480209.016465:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480209.016600:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.016633:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987c08c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480209.018047:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970688 00000100:00100000:1.0:1789480209.018060:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970688 00000100:00100000:1.0:1789480209.018118:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789480209.018128:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480209.022599:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970688:12345-0@lo:503:mount.lustre.0 Request processed in 4461us (5989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480209.022617:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789480209.022703:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789480209.024332:0:18652:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480209.024510:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480209.024593:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480209.024638:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aafb3ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480209.025407:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970816 00000100:00100000:0.0:1789480209.025418:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970816 00000100:00100000:0.0:1789480209.025476:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789480209.025571:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480209.025715:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970816:12345-0@lo:502:mount.lustre.0 Request processed in 148us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.025723:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789480209.025827:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480209.026098:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789480209.026127:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789480209.026140:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789480209.026152:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789480209.026165:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789480209.026178:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789480209.026833:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789480209.026858:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789480209.026874:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789480209.026888:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789480209.026902:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789480209.026929:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789480209.026946:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789480209.027037:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789480209.027053:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789480209.027066:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789480209.027079:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789480209.027093:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789480209.027108:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789480209.027121:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789480209.027133:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789480209.027146:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789480209.027159:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789480209.030158:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789480209.030411:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789480209.030439:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789480209.030454:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789480209.030466:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789480209.030589:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789480209.030615:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789480209.030630:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789480209.030642:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789480209.030657:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789480209.030670:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789480209.030685:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789480209.030698:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789480209.030712:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789480209.030726:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789480209.030741:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789480209.030773:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789480209.030789:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789480209.030804:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789480209.030818:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789480209.030833:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789480209.030849:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789480209.030862:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789480209.030877:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789480209.030891:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789480209.030965:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480209.031041:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480209.031165:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aafb3ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480209.031565:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527970944 00000100:00100000:2.0:1789480209.031574:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527970944 00000100:00100000:2.0:1789480209.031655:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789480209.031664:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480209.031832:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527970944:12345-0@lo:502:mount.lustre.0 Request processed in 168us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.031840:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789480209.031937:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527970944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480209.032109:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789480209.032134:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789480209.032159:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527971072:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480209.032711:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.032781:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aafb3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789480209.033116:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971072 00000100:00100000:1.0:1789480209.033124:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971072 00000100:00100000:1.0:1789480209.033217:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789480209.033227:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527971072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480209.033566:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527971072:12345-0@lo:502:mount.lustre.0 Request processed in 339us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480209.033574:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789480209.033648:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527971072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480209.033713:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789480209.033723:0:18652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789480209.034892:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789480209.034908:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a69869819c0) 00000020:00000080:2.0:1789480209.034997:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1789480209.035085:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab30a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789480209.035093:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6aab30a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789480209.035096:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6aab30a800 3 00010000:00080000:2.0:1789480209.035125:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a69874bf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789480209.041460:0:18678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789480209.041759:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789480209.041807:0:18678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789480209.041822:0:18678:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdaa289fda243e5ba 00000100:00080000:2.0:1789480209.041833:0:18678:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789480209.041848:0:18678:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a69874bf800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480209.041888:0:18678:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2dc00 x1876405527971200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480209.041919:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789480209.042766:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527971200:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480209.042836:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789480209.043100:0:18678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789480209.043115:0:18678:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a6a83460000) 00000020:00000080:3.0:1789480209.043134:0:18678:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789480209.043386:0:18678:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab30a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789480209.043391:0:18678:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6aab30a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789480209.043394:0:18678:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6aab30a800 3 00010000:00080000:3.0:1789480209.043433:0:18678:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a69869fe000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.144@tcp at head 00000100:00100000:0.0:1789480209.044372:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971200 00000100:00100000:0.0:1789480209.044385:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971200 00000100:00100000:0.0:1789480209.044427:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789480209.044435:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527971200:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789480209.044463:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:0.0:1789480209.044630:0:17154:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdaa289fda243e5c8 00000004:00100000:0.0:1789480209.044649:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789480209.044683:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6985d0b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480209.044764:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876405527971200:12345-0@lo:38:llog_process_th.0 Request processed in 329us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.044779:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789480209.044834:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6ac1c2dc00 x1876405527971200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480209.044845:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480209.044853:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789480209.044861:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789480209.044866:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789480209.044868:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a69874bf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789480209.044874:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1876405527971200:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789480209.047852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480209.047858:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480209.047861:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480209.047864:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480209.047894:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480209.047897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789480209.047899:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789480209.047902:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789480209.047953:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527971712:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.048056:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480209.048062:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527971328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048086:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.048130:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527971456:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048159:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.048177:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480209.048182:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527971584:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048396:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.048434:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971328 00000100:00100000:0.0:1789480209.048442:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971328 00000100:00100000:0.0:1789480209.048561:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971584 00000100:00100000:0.0:1789480209.048566:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971584 00000100:00100000:0.0:1789480209.048586:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789480209.048595:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527971328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048656:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527971328:12345-0@lo:400:kworker.0 Request processed in 62us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.048663:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789480209.048682:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480209.048687:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527971584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048717:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527971584:12345-0@lo:400:kworker.0 Request processed in 31us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.048723:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480209.048758:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527971584:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527971328:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048801:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971712 00000100:00100000:0.0:1789480209.048805:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971712 00000100:00100000:0.0:1789480209.048828:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971456 00000100:00100000:0.0:1789480209.048831:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971456 00000100:00100000:0.0:1789480209.048843:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789480209.048849:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527971712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.048892:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527971712:12345-0@lo:400:kworker.0 Request processed in 43us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480209.048899:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789480209.052609:0:18678:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789480209.052816:0:18678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789480209.052861:0:18678:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789480209.052874:0:18678:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdaa289fda243e5cf 00000100:00080000:3.0:1789480209.052883:0:18678:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480209.052894:0:18678:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a69869fe000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480209.052935:0:18678:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6986a1e680 x1876405527971840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480209.052976:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527971840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480209.053046:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.053183:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480209.053445:0:17153:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789480209.053453:0:17153:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:0.0:1789480209.053514:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6988a62a00 x1876405527971712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480209.053529:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527971712:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.054431:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527971456:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789480209.055064:0:18678:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789480209.055087:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480209.055091:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480209.055094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480209.055097:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480209.055100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480209.055103:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480209.055105:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480209.055108:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789480209.055392:0:18678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789480209.056154:0:18652:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789480209.056396:0:18652:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789480209.056422:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5ac expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480209.056434:0:18652:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd600/0xdaa289fda243e5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5ac expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789480209.056560:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789480209.056563:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480209.056564:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480209.056566:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480209.056567:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480209.056569:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480209.056571:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480209.056572:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480209.056574:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480209.056578:0:18652:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789480209.056580:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789480209.056582:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480209.056588:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480209.056588:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480209.056589:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480209.056590:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480209.056591:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480209.056592:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480209.056592:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789480209.056625:0:18652:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789480209.056642:0:18652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527971968:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789480209.056696:0:18652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480209.056725:0:18652:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab989c180 going to sleep for 11 seconds 00000100:00100000:0.0:1789480209.056767:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527971456:12345-0@lo:400:kworker.0 Request processed in 3560us (8606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.057068:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971968 00000100:00100000:2.0:1789480209.057076:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971968 00000100:00100000:2.0:1789480209.057130:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789480209.057139:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527971968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480209.057167:0:17145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789480209.057179:0:17145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789480209.060618:0:17151:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789480209.060635:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527971840 00000100:00100000:2.0:1789480209.060646:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527971840 00000100:00100000:2.0:1789480209.060677:0:17151:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789480209.060687:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480209.060696:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1876405527971840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789480209.060731:0:17151:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 577 last 0 00000020:00000080:2.0:1789480209.060782:0:17151:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdaa289fda243e5d6 00000004:00100000:2.0:1789480209.060799:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789480209.060836:0:17151:0:(import.c:65:import_set_state_nolock()) ffff8a69874ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480209.060946:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876405527971840:12345-0@lo:38:llog_process_th.0 Request processed in 249us (7900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.060954:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789480209.061154:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6986a1e680 x1876405527971840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480209.061166:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480209.061174:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789480209.061182:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789480209.061186:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789480209.061206:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a69869fe000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789480209.061213:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1876405527971840:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789480209.064352:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a6988a62300 x1876405527971456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480209.064397:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527971456:0@lo:400:kworker.0 00000100:00100000:0.0:1789480209.065444:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:2.0:1789480209.065736:0:17145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789480209.065752:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789480209.065905:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789480209.065909:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789480209.066008:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066039:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e520 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066047:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e52e expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066053:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066096:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066112:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 21 pid: 17145 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480209.066126:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527972096:0@lo:104: 00000100:00100000:3.0:1789480209.066218:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480209.066621:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066631:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 21 pid: 17147 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480209.066641:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527972224:0@lo:104: 00000100:00100000:3.0:1789480209.066669:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.066687:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480209.066710:0:17136:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789480209.066723:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972096 00000100:00100000:3.0:1789480209.066731:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972096 00000100:00100000:3.0:1789480209.066769:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972224 00000100:00100000:3.0:1789480209.066772:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972224 00000100:00100000:3.0:1789480209.066786:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480209.066793:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527972096:12345-0@lo:104: 00010000:00010000:3.0:1789480209.066806:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.066858:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789480209.066864:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527972096:12345-0@lo:104: Request processed in 71us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.066871:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480209.066887:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480209.066894:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527972224:12345-0@lo:104: 00010000:00010000:3.0:1789480209.066901:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480209.077958:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:18652:x1876405527971968:12345-0@lo:253:mount.lustre.0 Request processed in 20811us (21253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480209.077973:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789480209.078124:0:18652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:18652:1876405527971968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789480209.078141:0:18652:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789480209.078144:0:18652:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789480209.078146:0:18652:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789480209.078148:0:18652:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789480209.078149:0:18652:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789480209.078150:0:18652:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789480209.078151:0:18652:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789480209.078152:0:18652:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789480209.078154:0:18652:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789480209.078155:0:18652:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789480209.078170:0:18652:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1789480209.084206:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789480209.084354:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb03ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527972224:12345-0@lo:104: Request processed in 17327us (17550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.084369:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789480209.084432:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480209.084441:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084452:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db000 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480209.084456:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084468:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480209.084495:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480209.084501:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480209.084568:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084576:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480209.084600:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084608:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db000/0xdaa289fda243e52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e535 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084621:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480209.084625:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084630:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5dac00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:3.0:1789480209.084634:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084641:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789480209.084647:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480209.084652:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789480209.084673:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084679:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789480209.084693:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084699:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb5dac00/0xdaa289fda243e520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e527 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.084712:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480209.084714:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480209.084715:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480209.084731:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480209.084746:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527972352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480209.084786:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.084824:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789480209.084833:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527972480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480209.084858:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480209.084886:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972352 00000100:00100000:3.0:1789480209.084893:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972352 00000100:00100000:2.0:1789480209.085277:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527972096:0@lo:104: 00000100:00100000:2.0:1789480209.085289:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527972224:0@lo:104: 00010000:00010000:2.0:1789480209.085405:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480209.086100:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480209.086355:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972480 00000100:00100000:1.0:1789480209.086363:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972480 00010000:00010000:1.0:1789480209.086393:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 22 pid: 17147 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480209.086427:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480209.086437:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986b25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:3646:x1876405527972480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480209.086451:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480209.086458:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 22 pid: 17147 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480209.086470:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 22 pid: 17147 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480209.086487:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987ecc000/0xdaa289fda243e527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e520 expref: 22 pid: 17147 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480209.086501:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480209.086572:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986b25850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3646:x1876405527972480:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480209.086579:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789480209.087029:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 20 pid: 17145 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480209.087062:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480209.087071:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:3647:x1876405527972352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480209.087080:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480209.087085:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 20 pid: 17145 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087105:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 20 pid: 17145 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087116:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e52e expref: 20 pid: 17145 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087128:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087136:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789480209.087151:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021242328s 00010000:00010000:3.0:1789480209.087155:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087162:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087168:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087175:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087181:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480209.087185:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.087215:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.088027:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480209.088040:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480209.088104:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:3647:x1876405527972352:12345-0@lo:103:ldlm_bl.0 Request processed in 1034us (3315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480209.088113:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480209.088217:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527972480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789480209.088480:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527972352:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789480209.088586:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480209.088597:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480209.088603:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789480209.092441:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789480209.095078:0:18652:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789480209.095086:0:18652:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789480209.095124:0:18652:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789480209.095161:0:18652:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789480209.095178:0:18652:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789480209.095244:0:18652:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789480209.096671:0:18652:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789480209.096911:0:18652:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789480209.607705:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789480210.113731:0:18732:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789480210.113958:0:18732:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789480210.500354:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789480210.500365:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a698885a800 from 9 10000000:01000000:3.0:1789480210.500372:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789480210.500443:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480210.500457:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480210.500469:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480210.500502:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789480210.500609:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480210.500740:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a861cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480210.504815:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972608 00000100:00100000:1.0:1789480210.504834:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972608 00000100:00100000:0.0:1789480210.505079:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789480210.505092:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+19:17149:x1876405527972608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480210.505111:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480210.505150:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e5e4 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480210.505234:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480210.505247:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 20 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480210.505266:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:0.0:1789480210.505393:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:17149:x1876405527972608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 303us (4783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480210.505400:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789480210.505503:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480210.505524:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480210.505547:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480210.505629:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789480210.505689:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480210.506551:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa370c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789480210.506607:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972736 00000100:00100000:3.0:1789480210.506620:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972736 00000100:00100000:2.0:1789480210.506761:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789480210.506775:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:17149:x1876405527972736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789480210.506798:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789480210.506822:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789480210.506825:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789480210.510901:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:17149:x1876405527972736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 4116us (5198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480210.510920:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789480210.511578:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789480210.511832:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789480210.511845:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480210.511858:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480210.511871:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789480210.511874:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6988485000 from 9 10000000:01000000:2.0:1789480210.511878:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789480210.511916:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480210.511925:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480210.511936:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480210.511959:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480210.512583:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480210.512633:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480210.512774:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972864 00000100:00100000:3.0:1789480210.512782:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972864 00000100:00100000:3.0:1789480210.512839:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789480210.512850:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:17149:x1876405527972864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480210.512866:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480210.512883:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e5f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480210.512912:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480210.512922:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480210.512931:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd800, rc 0) 00000100:00100000:3.0:1789480210.512989:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527972864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480210.512996:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789480210.513094:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480210.513111:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480210.513574:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480210.513725:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480210.513776:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480210.513810:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a909b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789480210.515594:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527972992 00000100:00100000:2.0:1789480210.515611:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527972992 00000100:00100000:2.0:1789480210.515771:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789480210.515783:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527972992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789480210.515824:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789480210.515843:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789480210.515845:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789480210.515990:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527972992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 209us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480210.515998:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789480210.516515:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527972992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480210.516611:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480210.516621:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480210.516633:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480210.630166:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480211.653237:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480212.677693:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480212.997055:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480213.188781:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789480213.188809:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527973120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480213.188914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480213.188974:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973120 00000100:00100000:0.0:1789480213.188984:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973120 00000100:00100000:0.0:1789480213.189043:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480213.189052:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527973120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480213.189093:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789480213.189147:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527973120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480213.189154:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480213.189281:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988a62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527973120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789480213.189641:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480213.189653:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527973248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480213.189693:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480213.189825:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973248 00000100:00100000:3.0:1789480213.189831:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973248 00000100:00100000:3.0:1789480213.189869:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789480213.189877:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527973248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480213.189913:0:17893:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789480213.189959:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527973248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480213.189966:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789480213.189999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527973248:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789480213.700527:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789480214.212762:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480214.212782:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480214.212785:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480214.212788:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480214.212808:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480214.212811:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480214.212813:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480214.212817:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789480214.212858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527973760:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.212926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.212971:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789480214.212977:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527973376:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213006:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213033:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527973888:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213058:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213085:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527973504:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213109:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213126:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527974016:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213146:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213165:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789480214.213170:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527973632:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213207:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213226:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527974144:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213256:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480214.213300:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973760 00000100:00100000:3.0:1789480214.213310:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973760 00000100:00100000:3.0:1789480214.213349:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973504 00000100:00100000:3.0:1789480214.213353:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973504 00000100:00100000:3.0:1789480214.213370:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480214.213379:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527973760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480214.213551:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789480214.213562:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527973504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480214.213603:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527973504:12345-0@lo:400:kworker.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480214.213617:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789480214.213657:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527973504:0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213767:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527973760:12345-0@lo:400:kworker.0 Request processed in 389us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.213774:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789480214.213793:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973376 00000100:00100000:3.0:1789480214.213797:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973376 00000100:00100000:3.0:1789480214.213820:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789480214.213826:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3647:x1876405527973376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213854:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3647:x1876405527973376:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.213859:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789480214.213881:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973888 00000100:00100000:3.0:1789480214.213884:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973888 00000100:00100000:3.0:1789480214.213899:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974016 00000100:00100000:3.0:1789480214.213902:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974016 00000100:00100000:3.0:1789480214.213920:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527973632 00000100:00100000:3.0:1789480214.213923:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527973632 00000100:00100000:3.0:1789480214.213931:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974144 00000100:00100000:3.0:1789480214.213933:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974144 00000100:00100000:3.0:1789480214.213944:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480214.213948:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527973888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.213975:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527973888:12345-0@lo:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.213986:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789480214.213997:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480214.214001:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527974016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.214031:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527974016:12345-0@lo:400:kworker.0 Request processed in 30us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.214037:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480214.214046:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480214.214052:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527973632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.214077:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527973632:12345-0@lo:400:kworker.0 Request processed in 26us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.214082:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480214.214093:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480214.214098:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527974144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480214.214124:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527974144:12345-0@lo:400:kworker.0 Request processed in 26us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480214.214130:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789480214.214168:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1a78700 x1876405527973632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480214.214179:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527973632:0@lo:400:kworker.0 00010000:00080000:3.0:1789480214.214211:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988822a00 x1876405527974144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480214.214220:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527974144:0@lo:400:kworker.0 00010000:00080000:3.0:1789480214.214231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1a7ad80 x1876405527974016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480214.214247:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527974016:0@lo:400:kworker.0 00000100:00100000:1.0:1789480214.214973:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527973760:0@lo:400:kworker.0 00000100:00100000:1.0:1789480214.214990:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527973376:0@lo:400:kworker.0 00010000:00080000:1.0:1789480214.214999:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1a78a80 x1876405527973888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480214.215006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527973888:0@lo:400:kworker.0 00000100:00080000:1.0:1789480214.215036:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480214.215040:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789480214.283350:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789480214.728010:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480215.429347:0:19022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789480215.749712:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789480216.480015:0:19074:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789480216.485415:0:19074:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789480216.776176:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480217.222433:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480202/real 1789480202] req@ffff8a6ac1a79c00 x1876405527967616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480217.222469:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6ac1a79c00 x1876405527967616/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480217.222480:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480202/real 1789480202] req@ffff8a6ac1a78e00 x1876405527967360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480217 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480217.222493:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6ac1a78e00 x1876405527967360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480217 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480217.222550:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6aab027000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480217.222584:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480217.222589:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527967616:0@lo:8:kworker.0 00000100:00080000:0.0:1789480217.222596:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480217.222602:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789480217.222605:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527967360:0@lo:8:kworker.0 00000100:00080000:3.0:1789480217.222706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480217.222712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480217.222715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480217.222719:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480217.222743:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480217.222747:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789480217.222750:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6aab027000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480217.222756:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:3.0:1789480217.222761:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789480217.222774:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a6aab027000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480217.222796:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988820a80 x1876405527974784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480217.222800:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527974400:0@lo:400:kworker.0 00000100:00080000:3.0:1789480217.222822:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480217.222825:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789480217.222828:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480217.222832:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 571 00000100:00080000:3.0:1789480217.222835:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789480217.222839:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480217.222854:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988821180 x1876405527974912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789480217.222882:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.222931:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480217.222937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527974272:0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.222968:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.222999:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480217.223008:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527975040:0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.223041:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527974528:0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.223049:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.223075:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527975168:0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.223083:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480217.223140:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974272 00000100:00100000:1.0:1789480217.223150:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974272 00000100:00100000:1.0:1789480217.223236:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789480217.223247:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3648:x1876405527974272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.224558:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.224629:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974400 00000100:00100000:0.0:1789480217.224635:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974400 00000100:00100000:0.0:1789480217.224682:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480217.224691:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527974400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.225153:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527974400:12345-0@lo:400:kworker.0 Request processed in 462us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480217.225161:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480217.225240:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527974400:0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.230335:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975040 00000100:00100000:0.0:1789480217.230351:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975040 00000100:00100000:0.0:1789480217.230421:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974528 00000100:00100000:0.0:1789480217.230424:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974528 00000100:00100000:0.0:1789480217.230436:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975168 00000100:00100000:0.0:1789480217.230439:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975168 00000100:00100000:0.0:1789480217.230475:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789480217.230485:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527975040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.230612:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527975040:12345-0@lo:400:kworker.0 Request processed in 128us (7562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480217.230619:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789480217.230638:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480217.230644:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527974528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.230675:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527974528:12345-0@lo:400:kworker.0 Request processed in 31us (7593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480217.230680:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480217.230691:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789480217.230697:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527975168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.230738:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527975168:12345-0@lo:400:kworker.0 Request processed in 42us (6186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480217.230744:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789480217.230784:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527974656:0@lo:400:kworker.0 00000100:00100000:0.0:1789480217.230828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789480217.230887:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480217.230908:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527974784:0@lo:8:kworker.0 00000100:00100000:0.0:1789480217.230938:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.230997:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527974912:0@lo:8:kworker.0 00000100:00100000:0.0:1789480217.231171:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480217.231247:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974784 00000100:00100000:0.0:1789480217.231253:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974784 00000100:00100000:0.0:1789480217.231278:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974912 00000100:00100000:0.0:1789480217.231280:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974912 00000100:00100000:0.0:1789480217.231350:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480217.231356:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527974784:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789480217.231386:0:18658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:0.0:1789480217.231420:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e600 00002000:00100000:0.0:1789480217.231435:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a6985d09800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789480217.231439:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1789480217.231443:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789480217.231655:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789480217.231682:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8a6985d0d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480217.231728:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527974784:12345-0@lo:8:kworker.0 Request processed in 370us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480217.231735:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789480217.231750:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789480217.231755:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527974912:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789480217.231767:0:18658:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789480217.233142:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527974656 00000100:00100000:3.0:1789480217.233155:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527974656 00000100:00100000:3.0:1789480217.233233:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789480217.233254:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527974656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.233358:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527974656:12345-0@lo:400:kworker.0 Request processed in 117us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480217.233366:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789480217.233495:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820000 x1876405527974528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.233529:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527974528:0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.233541:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527975296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.233581:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480217.234406:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527974656:0@lo:400:kworker.0 00010000:00080000:2.0:1789480217.234454:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820a80 x1876405527974784/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480217.234465:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789480217.234474:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789480217.234485:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789480217.234491:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789480217.234494:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6aab027000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789480217.234525:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789480217.234532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527974784:0@lo:8:kworker.0 00000100:00100000:2.0:1789480217.234564:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975296 00000100:00100000:2.0:1789480217.234571:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975296 00000100:00100000:2.0:1789480217.234620:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789480217.234629:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527975296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480217.234689:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527975296:12345-0@lo:400:kworker.0 Request processed in 62us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480217.234696:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789480217.234733:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988821880 x1876405527975168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480217.234758:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527975168:0@lo:400:kworker.0 00010000:00080000:2.0:1789480217.234775:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820700 x1876405527975040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480217.234784:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527975040:0@lo:400:kworker.0 00000004:00080000:3.0:1789480217.236025:0:17894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789480217.236058:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975552:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1789480217.236125:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480217.236161:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86379480 going to sleep for 11 seconds 00000100:00100000:3.0:1789480217.236214:0:18659:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789480217.236222:0:18659:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:3.0:1789480217.236413:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988821500 x1876405527975296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.236426:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527975296:0@lo:400:kworker.0 00000100:00100000:3.0:1789480217.236452:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480217.236466:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527975424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480217.236494:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480217.236772:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975424 00000100:00100000:2.0:1789480217.236780:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975424 00000100:00100000:2.0:1789480217.236841:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789480217.236851:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527975424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480217.236893:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789480217.236942:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876405527975424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480217.236948:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480217.238084:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975552 00000100:00100000:3.0:1789480217.238095:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975552 00010000:00080000:3.0:1789480217.238163:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820000 x1876405527975424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.238184:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527975424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480217.239341:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3648:x1876405527974272:12345-0@lo:400:kworker.0 Request processed in 16090us (16366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480217.239355:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789480217.239402:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527974272:0@lo:400:kworker.0 00000100:00100000:2.0:1789480217.239636:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480217.239648:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1876405527975552:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1789480217.244258:0:17892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789480217.244386:0:17892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 586168194493ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789480217.244394:0:17892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1789480217.244426:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789480217.244436:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:1.0:1789480217.246467:0:19103:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789480217.246480:0:19103:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789480217.247759:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17894:x1876405527975552:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8107us (11626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480217.247777:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789480217.249461:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820380 x1876405527975552/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789480233 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.249481:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975552:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789480217.249498:0:17894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789480217.249558:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975680:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789480217.249620:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480217.249663:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86379480 going to sleep for 11 seconds 00000100:00100000:1.0:1789480217.249994:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975680 00000100:00100000:1.0:1789480217.250002:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975680 00000100:00100000:1.0:1789480217.250057:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789480217.250067:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1876405527975680:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789480217.250096:0:18659:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789480217.250141:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1876405527975680:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480217.250147:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789480217.252082:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820380 x1876405527975680/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789480233 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.252104:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975680:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789480217.252119:0:17894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000004:00080000:2.0:1789480217.252252:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789480217.252678:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975808:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789480217.252745:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480217.252826:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86379480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480217.252874:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975808 00000100:00100000:2.0:1789480217.252881:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975808 00000100:00100000:2.0:1789480217.252942:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480217.252953:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17894:x1876405527975808:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789480217.252998:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789480217.254919:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527974912:12345-0@lo:8:kworker.0 Request processed in 23149us (23735us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789480217.254936:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789480217.255186:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480217.255214:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789480217.255218:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527974912:0@lo:8:kworker.0 00000001:00080000:3.0:1789480217.286395:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789480217.286414:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789480217.286909:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17894:x1876405527975808:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33952us (34157us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789480217.286923:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789480217.287021:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820380 x1876405527975808/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789480233 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480217.287049:0:17894:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789480217.287057:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17894:1876405527975808:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789480217.287075:0:17894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789480217.287235:0:17894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1876405527975936:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789480217.287518:0:17894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480217.287553:0:17894:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86379480 going to sleep for 11 seconds 00000100:00100000:2.0:1789480217.287685:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527975936 00000100:00100000:2.0:1789480217.287700:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527975936 00000100:00100000:2.0:1789480217.287757:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480217.287767:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1876405527975936:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789480217.287835:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17894:x1876405527975936:12345-0@lo:900:osp-pre-0-1.0 Request processed in 70us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480217.287842:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789480217.287944:0:17894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820380 x1876405527975936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789480233 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480217.287976:0:17894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17894:1876405527975936:0@lo:900:osp-pre-0-1.0 00000020:00000004:1.0:1789480217.559512:0:19126:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789480217.559969:0:19126:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789480217.799821:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480218.308580:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480218.308609:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480218.308694:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480218.308752:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976064 00000100:00100000:3.0:1789480218.308763:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976064 00000100:00100000:3.0:1789480218.308824:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789480218.308835:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527976064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789480218.308874:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789480218.308936:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527976064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480218.308947:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789480218.308991:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527976064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480218.310060:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527976192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480218.310116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480218.310740:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976192 00000100:00100000:3.0:1789480218.310750:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976192 00000100:00100000:3.0:1789480218.310847:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789480218.310857:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527976192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789480218.310891:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789480218.311092:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527976192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 236us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480218.311099:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480218.312596:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527976192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789480218.820452:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480219.845798:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480220.868521:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480221.892311:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789480222.213705:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1789480222.404380:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480222.404387:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480222.404398:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480222.404401:0:13097:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789480222.404601:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527976320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.404692:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480222.409891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527976704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480222.410072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480222.410253:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480222.410263:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527976576:0@lo:400:kworker.0 00000100:00100000:0.0:1789480222.410293:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480222.411441:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480222.411456:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527976448:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.411518:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480222.411571:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976704 00000100:00100000:2.0:1789480222.411579:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976704 00000100:00100000:2.0:1789480222.411646:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789480222.411656:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527976704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480222.411690:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789480222.411737:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527976704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (1665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.411744:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789480222.411767:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480222.414398:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976320 00000100:00100000:2.0:1789480222.414411:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976320 00000100:00100000:2.0:1789480222.414502:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789480222.414514:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3645:x1876405527976320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.414633:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:3645:x1876405527976320:12345-0@lo:400:kworker.0 Request processed in 121us (9940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.414641:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789480222.414710:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527976320:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.417999:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976448 00000100:00100000:2.0:1789480222.418019:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976448 00000100:00100000:2.0:1789480222.418101:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480222.418112:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527976448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.419350:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527976448:12345-0@lo:400:kworker.0 Request processed in 1231us (7822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.419363:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480222.419540:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527976448:0@lo:400:kworker.0 00010000:00080000:0.0:1789480222.423522:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6a812ab100 x1876405527976704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480222.423557:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527976704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480222.425253:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976576 00000100:00100000:2.0:1789480222.425270:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976576 00000100:00100000:2.0:1789480222.425341:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480222.425352:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527976576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.430222:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527976576:12345-0@lo:400:kworker.0 Request processed in 4858us (19913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.430240:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789480222.431023:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527976832:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.431102:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789480222.431132:0:13097:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480222.431137:0:13097:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789480222.431141:0:13097:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480222.431147:0:13097:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 586 00000100:00080000:3.0:1789480222.431154:0:13097:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789480222.431166:0:13097:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480222.431926:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976832 00000100:00100000:3.0:1789480222.431938:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976832 00000100:00100000:3.0:1789480222.431996:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789480222.432005:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527976832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480222.432090:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527976832:12345-0@lo:400:kworker.0 Request processed in 86us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480222.432098:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789480222.432145:0:13097:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988822a00 x1876405527976960/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480222.432178:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527976960:0@lo:8:kworker.0 00000100:00100000:3.0:1789480222.432235:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480222.432272:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527976960 00000100:00100000:3.0:1789480222.432276:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527976960 00000100:00100000:3.0:1789480222.432295:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480222.432301:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876405527976960:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789480222.432322:0:18657:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789480222.433564:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527976832:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434308:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480222.434324:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527977088:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434399:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480222.434445:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977088 00000100:00100000:2.0:1789480222.434452:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977088 00000100:00100000:2.0:1789480222.434558:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789480222.434569:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527977088:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789480222.434602:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988820380 x1876405527976576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480222.434618:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527976576:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434625:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527977088:12345-0@lo:400:kworker.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.434634:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789480222.434669:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1c2c000 x1876405527977088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480222.434680:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527977088:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434721:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527977216:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480222.434815:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480222.434821:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527977344:0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434851:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480222.434875:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977216 00000100:00100000:2.0:1789480222.434879:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977216 00000100:00100000:2.0:1789480222.434913:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977344 00000100:00100000:2.0:1789480222.434917:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977344 00000100:00100000:2.0:1789480222.434933:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789480222.434938:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527977216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.434968:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527977216:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.434974:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789480222.434985:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789480222.434997:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527977344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480222.435027:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527977344:12345-0@lo:400:kworker.0 Request processed in 30us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480222.435033:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789480222.435048:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480222.435053:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789480222.435070:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1c2f100 x1876405527977344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480222.435080:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527977344:0@lo:400:kworker.0 00010000:00080000:2.0:1789480222.435090:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1c2c000 x1876405527977216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480222.435098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527977216:0@lo:400:kworker.0 00000100:00100000:3.0:1789480222.459892:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876405527976960:12345-0@lo:8:kworker.0 Request processed in 27577us (27644us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789480222.459929:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789480222.463395:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789480222.463409:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789480222.463415:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527976960:0@lo:8:kworker.0 00010000:00010000:0.0:1789480222.921083:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480223.433348:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527977472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480223.433439:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480223.433505:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480223.433512:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527977600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480223.433539:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480223.433728:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977472 00000100:00100000:0.0:1789480223.433742:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977472 00000100:00100000:0.0:1789480223.433808:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977600 00000100:00100000:0.0:1789480223.433812:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977600 00000100:00100000:0.0:1789480223.433828:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789480223.433837:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527977472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480223.433874:0:17893:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789480223.434701:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789480223.434715:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527977600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480223.434742:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789480223.435721:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527977472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1879us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480223.435734:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789480223.440165:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527977600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5440us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480223.440182:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789480223.440670:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527977600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480223.440691:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527977472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789480223.941300:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789480224.517240:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789480224.831151:0:19471:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789480224.831156:0:19471:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789480224.831158:0:19471:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789480224.831483:0:19471:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a6aab16f000 00000020:01000004:1.0:1789480224.831502:0:19471:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789480224.831521:0:19471:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789480224.831544:0:19471:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a6ab9ba4d40) 00000020:00000080:1.0:1789480224.831565:0:19471:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789480224.963507:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00010000:00010000:0.0:1789480224.964823:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789480224.969703:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789480224.970622:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789480224.970950:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789480224.971122:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789480224.973044:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789480224.977501:0:19471:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1789480224.981044:0:19471:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789480224.982437:0:19471:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789480224.982456:0:19471:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789480224.982484:0:19471:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdaa289fda243e60e 00000020:01000004:0.0:1789480224.982494:0:19471:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789480224.982522:0:19471:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789480224.982526:0:19471:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789480224.982533:0:19471:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789480224.982569:0:19471:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789480224.982574:0:19471:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789480225.006964:0:19471:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789480225.007016:0:19471:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789480225.007021:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789480225.007023:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789480225.007025:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480225.007026:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480225.007027:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480225.007029:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480225.007031:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480225.007032:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480225.007034:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480225.007038:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789480225.007040:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480225.007042:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789480225.007043:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480225.007044:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480225.007046:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480225.007047:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480225.007048:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480225.007049:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480225.007050:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789480225.007090:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789480225.007116:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977728:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480225.012505:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.012577:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480225.012690:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977728 00000100:00100000:2.0:1789480225.012702:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977728 00000100:00100000:2.0:1789480225.012762:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789480225.012774:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:19471:x1876405527977728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789480225.012810:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789480225.012814:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789480225.012819:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789480225.013612:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:19471:x1876405527977728:12345-0@lo:253:mount.lustre.0 Request processed in 837us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.013624:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789480225.013837:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977728:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789480225.013856:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789480225.013860:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789480225.013862:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789480225.013863:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480225.013864:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480225.013865:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480225.013866:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480225.013868:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480225.013888:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480225.013889:0:19471:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789480225.013911:0:19471:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a6aab16f000 from lustre-OST0001 10000000:01000000:1.0:1789480225.013952:0:19471:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789480225.013955:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789480225.013967:0:19471:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a698794b380 local copy 00010000:00010000:1.0:1789480225.013978:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480225.014101:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480225.014151:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.014187:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789480225.014475:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977856 00000100:00100000:2.0:1789480225.014482:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977856 00000100:00100000:2.0:1789480225.014530:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789480225.014540:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:19471:x1876405527977856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480225.014623:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:19471:x1876405527977856:12345-0@lo:501:mount.lustre.0 Request processed in 85us (487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789480225.014630:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789480225.014758:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789480225.014773:0:19471:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789480225.014794:0:19471:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789480225.014801:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.014812:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0000/0xdaa289fda243e328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e32f expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480225.014840:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a6aab16f000 10000000:01000000:1.0:1789480225.014845:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789480225.014851:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789480225.014853:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789480225.014858:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789480225.014862:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789480225.014885:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.014908:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.014919:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480225.014934:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789480225.014963:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.014982:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc0000 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.015044:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527977984 00000100:00100000:0.0:1789480225.015049:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527977984 00000100:00100000:0.0:1789480225.015088:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789480225.015096:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:19471:x1876405527977984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480225.015105:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480225.015120:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243e61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e615 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.015156:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243e61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e615 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.015175:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5db000/0xdaa289fda243e61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e615 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.015184:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5db000, rc 0) 00000100:00100000:0.0:1789480225.015262:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527977984:12345-0@lo:101:mount.lustre.0 Request processed in 167us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.015268:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789480225.017694:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527977984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480225.017727:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e61c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.017741:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e61c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480225.025315:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789480225.027918:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789480225.036085:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789480225.038934:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789480225.038984:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789480225.039001:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789480225.039016:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789480225.039053:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789480225.039088:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789480225.039094:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789480225.042284:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480225.042379:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.042442:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.042599:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978112 00000100:00100000:3.0:1789480225.042608:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978112 00000100:00100000:3.0:1789480225.042677:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789480225.042687:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480225.042896:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978112:12345-0@lo:501:mount.lustre.0 Request processed in 210us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.042905:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789480225.045102:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480225.045181:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789480225.045346:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.045411:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.045568:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978240 00000100:00100000:3.0:1789480225.045576:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978240 00000100:00100000:3.0:1789480225.045639:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789480225.045651:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480225.047871:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978240:12345-0@lo:503:mount.lustre.0 Request processed in 2212us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.047888:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789480225.048038:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789480225.048715:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789480225.048819:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480225.048889:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.049076:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.056494:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978368 00000100:00100000:0.0:1789480225.056515:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978368 00000100:00100000:0.0:1789480225.056601:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789480225.056613:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978368:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480225.057588:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978368:12345-0@lo:502:mount.lustre.0 Request processed in 974us (8695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.057599:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789480225.067833:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978368:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480225.068314:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789480225.068352:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789480225.068367:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789480225.068380:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789480225.068391:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789480225.068402:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789480225.068412:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789480225.068425:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789480225.068439:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789480225.068504:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480225.068588:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.068641:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb5eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.070310:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978496 00000100:00100000:0.0:1789480225.070325:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978496 00000100:00100000:0.0:1789480225.070398:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789480225.070409:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480225.070629:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978496:12345-0@lo:502:mount.lustre.0 Request processed in 221us (2040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.070637:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789480225.070896:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480225.071001:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789480225.071020:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789480225.072913:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789480225.072927:0:19475:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789480225.072935:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.072938:0:19475:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789480225.072945:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789480225.072973:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a6a85e13380) 00000020:00000080:0.0:1789480225.073006:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789480225.073014:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789480225.073098:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab16f000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789480225.073108:0:19475:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789480225.073115:0:19475:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdaa289fda243e62a 00010000:00010000:0.0:1789480225.088171:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789480225.090025:0:19475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789480225.095095:0:19475:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1789480225.100468:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789480225.100485:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480225.100493:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.100495:0:19475:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789480225.100498:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480225.100503:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.100504:0:19475:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789480225.100507:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789480225.100510:0:19475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789480225.100512:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480225.100514:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.100515:0:19475:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789480225.100518:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480225.100520:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.100521:0:19475:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789480225.100524:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789480225.100565:0:19475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480225.100569:0:19475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.100570:0:19475:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789480225.100574:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789480225.102343:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789480225.102398:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789480225.102424:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e61c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480225.102439:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb4bca00/0xdaa289fda243e615 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e61c expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789480225.102449:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6aab16f000 from 1 10000000:01000000:3.0:1789480225.102469:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789480225.102514:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480225.102523:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480225.102535:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480225.102564:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978624:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789480225.102651:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.102700:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a87f1ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.103360:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978624 00000100:00100000:0.0:1789480225.103372:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978624 00000100:00100000:0.0:1789480225.103433:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789480225.103443:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:19471:x1876405527978624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789480225.103477:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480225.103493:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e631 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.103523:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.103535:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480225.103545:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da400, rc 0) 00000100:00100000:0.0:1789480225.103603:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527978624:12345-0@lo:101:mount.lustre.0 Request processed in 162us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.103610:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789480225.103929:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789480225.103948:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480225.103957:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480225.107909:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789480225.108329:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480225.108634:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789480225.108658:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789480225.108675:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789480225.108680:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789480225.108763:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480225.108847:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.108895:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8289d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480225.109406:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978752 00000100:00100000:2.0:1789480225.109418:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978752 00000100:00100000:2.0:1789480225.109497:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789480225.109508:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527978752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789480225.109650:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527978752:12345-0@lo:501:mount.lustre.0 Request processed in 143us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.109657:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789480225.109972:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480225.110022:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480225.110067:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.110103:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8289d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.110339:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527978880 00000100:00100000:0.0:1789480225.110345:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527978880 00000100:00100000:0.0:1789480225.110383:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789480225.110392:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527978880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789480225.110597:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527978880:12345-0@lo:503:mount.lustre.0 Request processed in 205us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.110604:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789480225.110802:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527978880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789480225.111655:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789480225.111760:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480225.111822:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.111870:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8289d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789480225.111944:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979008 00000100:00100000:0.0:1789480225.111951:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979008 00000100:00100000:0.0:1789480225.111990:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789480225.112000:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527979008:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789480225.112117:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527979008:12345-0@lo:502:mount.lustre.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480225.112146:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789480225.112520:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789480225.112928:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789480225.112959:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789480225.112972:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789480225.112984:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789480225.112996:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789480225.113010:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789480225.113023:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789480225.113035:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1789480225.113047:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789480225.113059:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1789480225.113071:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1789480225.113101:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480225.113150:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.113347:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a8289d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480225.113532:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979136 00000100:00100000:2.0:1789480225.113539:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979136 00000100:00100000:2.0:1789480225.113617:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789480225.113626:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527979136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789480225.113759:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527979136:12345-0@lo:502:mount.lustre.0 Request processed in 134us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.113766:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789480225.113846:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789480225.113909:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1789480225.113926:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789480225.117928:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480225.117944:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.117947:0:19479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789480225.117955:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6aab16f000 00000020:00000080:0.0:1789480225.117958:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480225.117966:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480225.117968:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.117970:0:19479:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789480225.117972:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480225.117975:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.117976:0:19479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789480225.117978:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a6aab16f000 00000020:00000080:0.0:1789480225.117980:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480225.118089:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789480225.118093:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.118095:0:19479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789480225.118097:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789480225.118099:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789480225.118101:0:19479:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789480225.118105:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6aab16f000 00000020:00000080:0.0:1789480225.118107:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789480225.122361:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480225.123091:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480225.123096:0:19479:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789480225.123103:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789480225.123109:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480225.123111:0:19479:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789480225.123117:0:19479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a6aab16f000 00000020:00000080:1.0:1789480225.123127:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789480225.123236:0:19479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789480225.123241:0:19479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789480225.123242:0:19479:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789480225.123246:0:19479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1789480225.125871:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789480225.125933:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480225.125964:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.125979:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480225.126047:0:19471:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789480225.126050:0:19471:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a6aab16f000 10000000:01000000:2.0:1789480225.126054:0:19471:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a6aab16f000 10000000:01000000:2.0:1789480225.126059:0:19471:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789480225.126065:0:19471:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a6aab16f000 from 1 10000000:01000000:2.0:1789480225.126068:0:19471:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789480225.126117:0:19471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.126125:0:19471:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.126136:0:19471:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480225.126164:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789480225.126607:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.126665:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2a7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789480225.126732:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979264 00000100:00100000:1.0:1789480225.126740:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979264 00000100:00100000:1.0:1789480225.126799:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480225.126809:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:19471:x1876405527979264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480225.126825:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480225.126841:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e63f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.126867:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e63f expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.126879:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb4bce00/0xdaa289fda243e646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e63f expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.126888:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bce00, rc 0) 00000100:00100000:1.0:1789480225.126934:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979264:12345-0@lo:101:mount.lustre.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.126941:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789480225.126995:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789480225.127011:0:19471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e646 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.127020:0:19471:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e646 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789480225.129455:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1789480225.130716:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789480225.131685:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789480225.131715:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789480225.131743:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789480225.131755:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789480225.131765:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789480225.131775:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789480225.131785:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789480225.131794:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789480225.131804:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789480225.131816:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789480225.131829:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789480225.131843:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789480225.131875:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789480225.131891:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789480225.131906:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789480225.131919:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789480225.131932:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789480225.131947:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789480225.131961:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789480225.131974:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789480225.131988:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789480225.132002:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789480225.132016:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789480225.132030:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789480225.132043:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789480225.132058:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789480225.132071:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789480225.132085:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789480225.132114:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789480225.132138:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789480225.132152:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789480225.132164:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789480225.132175:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789480225.132217:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789480225.132237:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789480225.132250:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789480225.132262:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789480225.132276:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789480225.132290:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1789480225.132310:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1789480225.132323:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1789480225.132335:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1789480225.132349:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1789480225.132364:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1789480225.132394:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1789480225.132412:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1789480225.132436:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1789480225.132443:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789480225.132609:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480225.139608:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.139702:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.139823:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979392 00000100:00100000:3.0:1789480225.139834:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979392 00000100:00100000:3.0:1789480225.139901:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789480225.139913:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789480225.140127:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979392:12345-0@lo:501:mount.lustre.0 Request processed in 217us (7434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.140136:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789480225.140409:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789480225.140484:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789480225.140536:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.140561:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.145364:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979520 00000100:00100000:3.0:1789480225.145384:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979520 00000100:00100000:3.0:1789480225.145480:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789480225.145493:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789480225.145698:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979520:12345-0@lo:503:mount.lustre.0 Request processed in 208us (5160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.145707:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789480225.145996:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979520:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789480225.146581:0:19471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789480225.146677:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979648:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480225.146745:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.146787:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480225.150332:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979648 00000100:00100000:1.0:1789480225.150351:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979648 00000100:00100000:1.0:1789480225.150433:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789480225.150445:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480225.150657:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979648:12345-0@lo:502:mount.lustre.0 Request processed in 215us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.150666:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789480225.150747:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979648:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480225.151151:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789480225.151247:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789480225.151269:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789480225.151300:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789480225.151318:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789480225.151332:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789480225.151346:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789480225.151361:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789480225.151373:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789480225.151384:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789480225.151396:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789480225.151426:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789480225.151443:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789480225.151819:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789480225.151921:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789480225.151935:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789480225.151945:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789480225.151955:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789480225.151965:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789480225.153414:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789480225.153449:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789480225.153475:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789480225.153490:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789480225.153504:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789480225.153518:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789480225.153530:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789480225.153545:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789480225.153580:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789480225.153595:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789480225.153608:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789480225.153620:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789480225.153634:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789480225.153647:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789480225.153660:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789480225.153674:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789480225.153687:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789480225.153699:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789480225.153711:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789480225.153726:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789480225.153740:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789480225.153755:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789480225.153768:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789480225.153781:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789480225.153810:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789480225.153946:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789480225.153966:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789480225.153979:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789480225.153991:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789480225.154054:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979776:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480225.154138:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.154216:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.154416:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979776 00000100:00100000:3.0:1789480225.154425:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979776 00000100:00100000:3.0:1789480225.154489:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789480225.154499:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480225.154638:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979776:12345-0@lo:502:mount.lustre.0 Request processed in 140us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.154646:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789480225.155496:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789480225.155724:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789480225.155754:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789480225.155786:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789480225.156522:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.156573:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789480225.157380:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527979904 00000100:00100000:3.0:1789480225.157390:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527979904 00000100:00100000:3.0:1789480225.157442:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789480225.157452:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789480225.157597:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527979904:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.157605:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789480225.160232:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527979904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789480225.160489:0:19471:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789480225.160509:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789480225.166975:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789480225.166998:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a6a85e28000) 00000020:00000080:2.0:1789480225.167027:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789480225.167138:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab16f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789480225.167142:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6aab16f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789480225.167145:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6aab16f000 3 00010000:00080000:2.0:1789480225.167178:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6986ac5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1789480225.174115:0:19484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789480225.174988:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789480225.175054:0:19484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789480225.175070:0:19484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdaa289fda243e654 00000100:00080000:3.0:1789480225.175082:0:19484:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789480225.175096:0:19484:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a6986ac5000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480225.175133:0:19484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6988823800 x1876405527980032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480225.175177:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527980032:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480225.175360:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789480225.175475:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789480225.175529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480225.175534:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480225.175537:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480225.175540:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480225.175578:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480225.175582:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789480225.175584:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789480225.175590:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 591 00000100:00080000:3.0:1789480225.175593:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789480225.175599:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1789480225.175612:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6987da8a80 x1876405527980672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480225.175659:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527980160:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.175693:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.175715:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527980800:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.175746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.175769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789480225.175775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527980288:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.175796:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.175816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527980928:0@lo:400:kworker.0 00000100:00100000:2.0:1789480225.175816:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980032 00000100:00100000:2.0:1789480225.175824:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980032 00000100:00100000:2.0:1789480225.175855:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980800 00000100:00100000:2.0:1789480225.175858:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980800 00000100:00100000:2.0:1789480225.175881:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980288 00000100:00100000:2.0:1789480225.175884:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980288 00000100:00100000:2.0:1789480225.175899:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480225.175908:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527980800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480225.175960:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876405527980800:12345-0@lo:400:kworker.0 Request processed in 53us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.175973:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789480225.175987:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480225.175992:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527980288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480225.176033:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527980288:12345-0@lo:400:kworker.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.176039:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480225.176052:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789480225.176056:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876405527980032:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789480225.176076:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:2.0:1789480225.176116:0:17154:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdaa289fda243e65b 00000004:00100000:2.0:1789480225.176132:0:17154:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789480225.176162:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6986ac7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480225.177392:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988822a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876405527980032:12345-0@lo:38:llog_process_th.0 Request processed in 1326us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480225.177404:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480225.177769:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789480225.177823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6987daa300 x1876405527980800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.177976:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876405527980800:0@lo:400:kworker.0 00010000:00080000:3.0:1789480225.178007:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988821180 x1876405527980288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.178016:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527980288:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178047:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527980416:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178084:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.178117:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527981056:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178139:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.178165:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480225.178171:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527980544:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178212:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.178253:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980160 00000100:00100000:3.0:1789480225.178261:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980160 00000100:00100000:3.0:1789480225.178382:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980416 00000100:00100000:3.0:1789480225.178387:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980416 00000100:00100000:1.0:1789480225.178391:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980928 00000100:00100000:1.0:1789480225.178395:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980928 00000100:00100000:3.0:1789480225.178404:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789480225.178411:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527980160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480225.178428:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981056 00000100:00100000:1.0:1789480225.178431:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981056 00000100:00100000:1.0:1789480225.178446:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789480225.178453:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527980928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178498:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527980160:12345-0@lo:400:kworker.0 Request processed in 86us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.178498:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527980928:12345-0@lo:400:kworker.0 Request processed in 45us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.178505:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480225.178506:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789480225.178520:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789480225.178520:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789480225.178527:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527980416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480225.178527:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527981056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480225.178559:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527981056:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.178565:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789480225.178582:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480225.178587:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480225.178659:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527980416:12345-0@lo:400:kworker.0 Request processed in 132us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.178666:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789480225.178696:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980544 00000100:00100000:3.0:1789480225.178700:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980544 00000100:00100000:3.0:1789480225.178746:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789480225.178753:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527980544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178786:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527980544:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.178791:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789480225.178823:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6987daad80 x1876405527980544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480225.178845:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480225.178911:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527980544:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178925:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527980416:0@lo:400:kworker.0 00010000:00080000:3.0:1789480225.178934:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6987da8000 x1876405527981056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.178942:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527981056:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.178971:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527980672:0@lo:8:kworker.0 00000100:00100000:3.0:1789480225.178999:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789480225.179044:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6988823800 x1876405527980032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.179052:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480225.179061:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789480225.179070:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789480225.179075:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789480225.179079:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6986ac5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789480225.179086:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1876405527980032:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789480225.179120:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6987daaa00 x1876405527980928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.179129:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987daaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527980928:0@lo:400:kworker.0 00000100:00100000:3.0:1789480225.179139:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527980160:0@lo:400:kworker.0 00000100:00100000:1.0:1789480225.179442:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527980672 00000100:00100000:1.0:1789480225.179448:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527980672 00000100:00100000:1.0:1789480225.179491:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789480225.179505:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876405527980672:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789480225.179562:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1876405527980672:12345-0@lo:8:kworker.0 Request processed in 57us (562us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789480225.179568:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480225.180417:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000020:01000004:2.0:1789480225.180532:0:19484:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789480225.180554:0:19484:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a6a85e2b380) 00000020:00000080:2.0:1789480225.180585:0:19484:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789480225.180685:0:19484:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a6aab16f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789480225.180689:0:19484:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a6aab16f000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789480225.180692:0:19484:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a6aab16f000 3 00000100:00080000:3.0:1789480225.180899:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789480225.180904:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789480225.180909:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527980672:0@lo:8:kworker.0 00010000:00080000:2.0:1789480225.181395:0:19484:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a6986ac2800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1789480225.187044:0:19484:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789480225.187367:0:19484:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789480225.188164:0:19484:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789480225.188181:0:19484:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdaa289fda243e669 00000100:00080000:2.0:1789480225.188231:0:19484:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789480225.188247:0:19484:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a6986ac2800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480225.188287:0:19484:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2fb80 x1876405527981184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480225.188320:0:19484:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789480225.190047:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480225.190060:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789480225.190062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789480225.190066:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789480225.190110:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527981184:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789480225.190221:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480225.190306:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981184 00000100:00100000:3.0:1789480225.190314:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981184 00000100:00100000:3.0:1789480225.190353:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789480225.190361:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1876405527981184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789480225.190393:0:17153:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:3.0:1789480225.190448:0:17153:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdaa289fda243e670 00000004:00100000:3.0:1789480225.190474:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789480225.190512:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8a69869f9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480225.190564:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876405527981184:12345-0@lo:38:llog_process_th.0 Request processed in 202us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480225.190572:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789480225.190771:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a6ac1c2fb80 x1876405527981184/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789480235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480225.190784:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789480225.190795:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789480225.190806:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789480225.190813:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789480225.190815:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6986ac2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789480225.190821:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1876405527981184:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789480225.192222:0:19484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789480225.192991:0:19471:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789480225.193035:0:19471:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789480225.193054:0:19471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e646 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.193068:0:19471:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c1400/0xdaa289fda243e63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e646 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789480225.193132:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789480225.193135:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789480225.193136:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480225.193138:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480225.193139:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480225.193141:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480225.193142:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480225.193144:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480225.193145:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480225.193150:0:19471:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789480225.193152:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789480225.193154:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789480225.193155:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789480225.193156:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789480225.193157:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789480225.193158:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789480225.193159:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789480225.193161:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789480225.193162:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789480225.193256:0:19471:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789480225.193280:0:19471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527981312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789480225.193371:0:19471:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.193425:0:19471:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab6bc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480225.193471:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981312 00000100:00100000:1.0:1789480225.193479:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981312 00000100:00100000:1.0:1789480225.193530:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789480225.193540:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527981312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789480225.193568:0:17146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789480225.193585:0:17146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789480225.212548:0:17146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789480225.212576:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789480225.213036:0:17168:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789480225.213043:0:17168:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789480225.213070:0:17168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.213092:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.213100:0:17168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.213107:0:17168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.213152:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.213169:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 24 pid: 17147 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480225.213185:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527981440:0@lo:104: 00000100:00100000:1.0:1789480225.213685:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:19471:x1876405527981312:12345-0@lo:253:mount.lustre.0 Request processed in 20143us (20310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.213697:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789480225.213800:0:19471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:51483ccc-9e15-472d-aee3-1dbbbf4be94f:19471:1876405527981312:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789480225.213815:0:19471:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789480225.213819:0:19471:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789480225.213821:0:19471:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789480225.213822:0:19471:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789480225.213824:0:19471:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789480225.213893:0:19471:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789480225.213909:0:19471:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789480225.213911:0:19471:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789480225.213913:0:19471:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789480225.213915:0:19471:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789480225.213931:0:19471:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789480225.216135:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789480225.216314:0:17168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480225.216349:0:17168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 23 pid: 17146 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480225.216365:0:17168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527981568:0@lo:104: 00000100:00100000:2.0:1789480225.216392:0:17168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480225.216491:0:17168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a99129780 going to sleep for 11 seconds 00000001:00000004:2.0:1789480225.220576:0:19471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789480225.220749:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981440 00000100:00100000:1.0:1789480225.220760:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981440 00000100:00100000:1.0:1789480225.220803:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981568 00000100:00100000:1.0:1789480225.220806:0:17135:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981568 00000100:00100000:1.0:1789480225.220825:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480225.220835:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527981440:12345-0@lo:104: 00010000:00010000:1.0:1789480225.220856:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.220976:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480225.220983:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:17168:x1876405527981440:12345-0@lo:104: Request processed in 150us (4852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.220990:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480225.221008:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480225.221015:0:17135:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527981568:12345-0@lo:104: 00010000:00010000:1.0:1789480225.221024:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221075:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789480225.221080:0:17135:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:17168:x1876405527981568:12345-0@lo:104: Request processed in 67us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.221087:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789480225.221109:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480225.221115:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221123:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0800 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480225.221128:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221137:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480225.221145:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480225.221151:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789480225.221209:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221216:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480225.221252:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221258:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6abb3c0800/0xdaa289fda243e5f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5f9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221284:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480225.221287:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221293:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc600 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480225.221296:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221304:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480225.221310:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480225.221316:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789480225.221331:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221337:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480225.221354:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221361:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc600/0xdaa289fda243e5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e5eb expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221375:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480225.221377:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480225.221379:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480225.221386:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480225.221426:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527981696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480225.221482:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.221534:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789480225.221542:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527981824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480225.221565:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480225.221594:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981696 00000100:00100000:1.0:1789480225.221599:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981696 00010000:00010000:1.0:1789480225.221621:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 24 pid: 17147 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480225.221642:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981824 00000100:00100000:1.0:1789480225.221646:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981824 00010000:00010000:1.0:1789480225.221658:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 25 pid: 17146 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480225.221676:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480225.221682:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+25:3646:x1876405527981696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480225.221692:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480225.221698:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 25 pid: 17147 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221709:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 25 pid: 17147 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221726:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480225.221753:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+25:3646:x1876405527981696:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.221760:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480225.221773:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480225.221779:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3648:x1876405527981824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480225.221793:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480225.221797:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 24 pid: 17146 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221805:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 24 pid: 17146 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221817:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221825:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789480225.221841:0:17139:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021242328s 00010000:00010000:1.0:1789480225.221846:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221853:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221860:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221867:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221872:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480225.221877:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221885:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221900:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.221910:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480225.221943:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3648:x1876405527981824:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480225.221953:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480225.221997:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527981696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480225.222031:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987ecd800/0xdaa289fda243e5f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e5f2 expref: 23 pid: 17147 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480225.222035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527981824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480225.222041:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527981440:0@lo:104: 00010000:00010000:1.0:1789480225.222051:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5daa00/0xdaa289fda243e5eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e5e4 expref: 22 pid: 17146 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480225.222062:0:17168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17168:1876405527981568:0@lo:104: 00010000:00010000:1.0:1789480225.222083:0:17168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.222092:0:17168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.222098:0:17168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480225.222105:0:17168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c0400/0xdaa289fda243e677 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789480225.226960:0:19471:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789480225.226973:0:19471:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789480225.227021:0:19471:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789480225.227070:0:19471:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789480225.227096:0:19471:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1789480225.227131:0:19471:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1789480225.228686:0:19471:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789480225.232732:0:19471:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789480225.989020:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480226.247181:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480205/real 1789480205] req@ffff8a6ac1a7b100 x1876405527968128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480226.248083:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6ac1a7b100 x1876405527968128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480226.248097:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789480205/real 1789480205] req@ffff8a6ac1a7a300 x1876405527968000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480226.248111:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a6ac1a7a300 x1876405527968000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789480225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789480226.248133:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789480226.248250:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789480226.248256:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527968128:0@lo:8:kworker.0 00000100:00080000:1.0:1789480226.248264:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789480226.255982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480226.255990:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789480226.255995:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480226.256004:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:2.0:1789480226.256020:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789480226.256035:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a6a97c49000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480226.256063:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2f800 x1876405527982208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480226.256077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480226.256081:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480226.256083:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480226.256087:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 573 00000100:00080000:2.0:1789480226.256089:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789480226.256094:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a6a8bea8800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480226.256107:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2fb80 x1876405527982336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789480226.256138:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789480226.256150:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789480226.256152:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789480226.256161:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a6987e15000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1789480226.256177:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a6ac1c2dc00 x1876405527982848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789480226.256551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527981952:0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.256640:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.256694:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527982720:0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.256730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.256754:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527983360:0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.256783:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.256830:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789480226.256838:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527982592:0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.256869:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.256900:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527983232:0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.257127:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.257172:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982720 00000100:00100000:3.0:1789480226.257181:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982720 00000100:00100000:3.0:1789480226.257271:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480226.257281:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.257348:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527982720:12345-0@lo:400:kworker.0 Request processed in 69us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.257356:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789480226.257381:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983360 00000100:00100000:3.0:1789480226.257385:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983360 00000100:00100000:3.0:1789480226.257429:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983232 00000100:00100000:3.0:1789480226.257433:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983232 00000100:00100000:3.0:1789480226.257467:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789480226.257475:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527983360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.257514:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527983360:12345-0@lo:400:kworker.0 Request processed in 40us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.257521:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789480226.257536:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789480226.257545:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527983232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480226.257575:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527983232:12345-0@lo:400:kworker.0 Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.257581:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789480226.257627:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1fb80 x1876405527983232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.257642:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527983232:0@lo:400:kworker.0 00010000:00080000:3.0:1789480226.257655:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2f480 x1876405527982720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.257663:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527982720:0@lo:400:kworker.0 00010000:00080000:3.0:1789480226.257673:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1f100 x1876405527983360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.257696:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527983360:0@lo:400:kworker.0 00000100:00100000:2.0:1789480226.258231:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982592 00000100:00100000:2.0:1789480226.258239:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982592 00000100:00100000:2.0:1789480226.258282:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480226.258290:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527982592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480226.258346:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527982592:12345-0@lo:400:kworker.0 Request processed in 57us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480226.258352:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480226.258384:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527982592:0@lo:400:kworker.0 00000100:00080000:1.0:1789480226.258619:0:3644:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789480226.258626:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527968000:0@lo:8:kworker.0 00000100:00100000:1.0:1789480226.258660:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527982208:0@lo:8:kworker.0 00000100:00100000:1.0:1789480226.258712:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.258759:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527982336:0@lo:8:kworker.0 00000100:00100000:1.0:1789480226.258804:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.258834:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527982848:0@lo:8:kworker.0 00000100:00100000:1.0:1789480226.258861:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.258923:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527982080:0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.258950:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.258981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527982976:0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.259160:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.259187:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527983488:0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.259248:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.259268:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789480226.259275:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527982464:0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.259298:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.259317:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527983104:0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.259339:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.259372:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527981952 00000100:00100000:1.0:1789480226.259379:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527981952 00000100:00100000:1.0:1789480226.259418:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789480226.259426:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:3648:x1876405527981952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.259489:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:3648:x1876405527981952:12345-0@lo:400:kworker.0 Request processed in 63us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.259496:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789480226.259659:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480226.259678:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982208 00000100:00100000:1.0:1789480226.259682:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982208 00000100:00100000:1.0:1789480226.259703:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982336 00000100:00100000:1.0:1789480226.259706:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982336 00000100:00100000:1.0:1789480226.259713:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982848 00000100:00100000:1.0:1789480226.259716:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982848 00000100:00100000:1.0:1789480226.259724:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480226.259729:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527982208:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789480226.259757:0:18658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1789480226.259791:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e67e 00002000:00100000:1.0:1789480226.259814:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a6986875800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789480226.259818:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789480226.259822:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789480226.260100:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789480226.260126:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8a6986871800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480226.260173:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527982208:12345-0@lo:8:kworker.0 Request processed in 442us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.260180:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789480226.260217:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480226.260221:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527982336:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789480226.260238:0:18658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1789480226.260256:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdaa289fda243e685 00002000:00100000:1.0:1789480226.260262:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a6986874000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789480226.260266:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789480226.260268:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789480226.260435:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480226.260448:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8a6986875000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480226.260492:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876405527982336:12345-0@lo:8:kworker.0 Request processed in 269us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.260498:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789480226.260513:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480226.260517:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1876405527982848:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789480226.260680:0:18658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:1.0:1789480226.260698:0:18658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdaa289fda243e68c 00002000:00100000:1.0:1789480226.260704:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a6986873800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789480226.260719:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1789480226.260721:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789480226.260749:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789480226.260760:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8a6986874800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480226.260788:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1876405527982848:12345-0@lo:8:kworker.0 Request processed in 270us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.260865:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480226.261012:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982080 00000100:00100000:1.0:1789480226.261019:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982080 00000100:00100000:1.0:1789480226.261105:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789480226.261114:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527982080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480226.261165:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527982080:12345-0@lo:400:kworker.0 Request processed in 53us (2214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.261172:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480226.261327:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982976 00000100:00100000:0.0:1789480226.261343:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982976 00000100:00100000:0.0:1789480226.261389:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983488 00000100:00100000:0.0:1789480226.261394:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983488 00000100:00100000:0.0:1789480226.261443:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527982464 00000100:00100000:0.0:1789480226.261447:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527982464 00000100:00100000:0.0:1789480226.261474:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983104 00000100:00100000:0.0:1789480226.261478:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983104 00000100:00100000:0.0:1789480226.261497:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789480226.261506:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527982976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480226.261592:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876405527982976:12345-0@lo:400:kworker.0 Request processed in 88us (2585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480226.261600:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789480226.261619:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789480226.261625:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527983488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480226.261658:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876405527983488:12345-0@lo:400:kworker.0 Request processed in 33us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480226.261665:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789480226.261679:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480226.261686:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527982464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480226.261716:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876405527982464:12345-0@lo:400:kworker.0 Request processed in 31us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480226.261722:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789480226.261738:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789480226.261746:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527983104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480226.261775:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527983104:12345-0@lo:400:kworker.0 Request processed in 31us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480226.261781:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789480226.261876:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527981952:0@lo:400:kworker.0 00010000:00080000:0.0:1789480226.261925:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2d500 x1876405527982464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.261946:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876405527982464:0@lo:400:kworker.0 00010000:00080000:0.0:1789480226.261960:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1f480 x1876405527983104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.261968:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527983104:0@lo:400:kworker.0 00000100:00100000:0.0:1789480226.261979:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527982080:0@lo:400:kworker.0 00010000:00080000:0.0:1789480226.261989:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1ea00 x1876405527982976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.261997:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876405527982976:0@lo:400:kworker.0 00010000:00080000:0.0:1789480226.262011:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e680 x1876405527983488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.262018:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1876405527983488:0@lo:400:kworker.0 00010000:00080000:0.0:1789480226.262054:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2f800 x1876405527982208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.262063:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480226.262072:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789480226.262080:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789480226.262085:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789480226.262088:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a97c49000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789480226.262103:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789480226.262110:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527982208:0@lo:8:kworker.0 00010000:00080000:0.0:1789480226.262125:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2fb80 x1876405527982336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480226.262147:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789480226.262153:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789480226.262159:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789480226.262163:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789480226.262166:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6a8bea8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789480226.262187:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789480226.262480:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1876405527982336:0@lo:8:kworker.0 00000004:00080000:2.0:1789480226.262497:0:17179:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00010000:00080000:0.0:1789480226.262506:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6ac1c2dc00 x1876405527982848/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789480251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789480226.262517:0:3644:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789480226.262522:0:3644:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789480226.262526:0:3644:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789480226.262529:0:3644:0:(import.c:65:import_set_state_nolock()) ffff8a6987e15000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789480226.262542:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1876405527983744:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789480226.262546:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789480226.262553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1876405527982848:0@lo:8:kworker.0 00000004:00080000:0.0:1789480226.262583:0:17895:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789480226.262603:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480226.262642:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86379a80 going to sleep for 11 seconds 00000004:00080000:0.0:1789480226.262673:0:17895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 595186481770ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789480226.262681:0:17895:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789480226.262726:0:17176:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789480226.262765:0:17176:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 595186574640ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789480226.262770:0:17176:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789480226.262819:0:17177:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1789480226.262838:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1876405527984000:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789480226.262881:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480226.262904:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa370c0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789480226.262922:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480226.262931:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480226.262940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527983872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480226.262965:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480226.262997:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527983616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480226.263018:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789480226.263048:0:17178:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789480226.263118:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983744 00000100:00100000:0.0:1789480226.263125:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983744 00000100:00100000:0.0:1789480226.263175:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984000 00000100:00100000:0.0:1789480226.263179:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984000 00000100:00100000:0.0:1789480226.263248:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480226.263278:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789480226.263278:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17179:x1876405527983744:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789480226.263300:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17177:x1876405527984000:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789480226.263544:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480226.263549:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480226.263671:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983872 00000100:00100000:2.0:1789480226.263681:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983872 00000004:00080000:0.0:1789480226.263719:0:17896:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789480226.263720:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527983616 00000100:00100000:2.0:1789480226.263726:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527983616 00000100:00100000:2.0:1789480226.263754:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480226.263764:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527983872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480226.263791:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984256:0@lo:7:osp-pre-1-1.0 00002000:00000024:2.0:1789480226.263802:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480226.263837:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.265138:0:18657:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1789480226.265151:0:18657:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789480226.265370:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984256 00000100:00100000:3.0:1789480226.265379:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984256 00000100:00080000:3.0:1789480226.265435:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789480226.267155:0:17178:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 595190960684ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789480226.267177:0:17178:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789480226.267707:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789480226.267726:0:19538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17896:x1876405527984256:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1789480226.268036:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789480226.268773:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1876405527983872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5006us (5801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480226.269119:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480226.269154:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789480226.269165:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527983616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480226.269187:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789480226.269311:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876405527983616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (6290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480226.269317:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789480226.269789:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6986a1e680 x1876405527983616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480226.270521:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480226.270619:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527983616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480226.270686:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527984128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480226.270750:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.271178:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984128 00000100:00100000:3.0:1789480226.271186:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984128 00000100:00100000:3.0:1789480226.271270:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480226.271281:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876405527984128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480226.271303:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789480226.271352:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1876405527984128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.271359:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789480226.271436:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aa300 x1876405527984128/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480226.271465:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527984128:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789480226.271519:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aaa00 x1876405527983872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789480242 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480226.271644:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527983872:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789480226.272339:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789480226.272390:0:19103:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789480226.272402:0:19103:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789480226.272409:0:19103:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:0.0:1789480226.272817:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aa370cf00 going to sleep for 11 seconds 00002000:00080000:2.0:1789480226.275466:0:18658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789480226.275482:0:18658:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789480226.275491:0:18658:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:0.0:1789480226.275860:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1789480226.280023:0:19538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789480226.280038:0:19538:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789480226.280170:0:19538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17896:x1876405527984256:12345-0@lo:7:osp-pre-1-1.0 Request processed in 12446us (16329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.280182:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789480226.280300:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812a8e00 x1876405527984256/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789480242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.280334:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984256:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789480226.280351:0:17896:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789480226.280400:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984384:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789480226.280470:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.280508:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984384 00000100:00100000:3.0:1789480226.280515:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984384 00000100:00100000:3.0:1789480226.280555:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480226.280564:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1876405527984384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789480226.280591:0:18657:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789480226.280618:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1876405527984384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.280624:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789480226.280647:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7b40 going to sleep for 11 seconds 00010000:00080000:3.0:1789480226.280661:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9180 x1876405527984384/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789480242 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.280672:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984384:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789480226.280681:0:17896:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789480226.280707:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984512:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789480226.280729:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.280743:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480226.280755:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984512 00000100:00100000:3.0:1789480226.280759:0:19538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984512 00000100:00100000:3.0:1789480226.280787:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480226.282673:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1876405527984512:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789480226.282740:0:18657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000020:00000004:0.0:1789480226.285690:0:19537:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789480226.285936:0:19537:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00002000:00010000:0.0:1789480226.293387:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.293403:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.293422:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.293427:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.293433:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.293474:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.293487:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.293496:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.293521:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.294248:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.294261:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.294295:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.294300:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.294312:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.294337:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.294345:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e693 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.294375:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.294377:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.294378:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.297760:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.297777:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.297797:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.297803:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.297809:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298011:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298034:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298042:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298066:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.298080:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.298086:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298093:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.298098:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298107:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298123:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298130:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e69a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.298150:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.298157:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.298159:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.301173:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.301211:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.301242:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.301247:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.301253:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.301268:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.301280:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.301288:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.301317:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480226.302036:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.302046:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.302056:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bde00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.302061:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.302071:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.302095:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.302104:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084c1ba2f/0xdaa289fda243e6a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.302130:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.302132:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.302134:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.304818:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.304838:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.304857:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.304861:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.304867:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.304902:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.305171:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.305180:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.305232:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480226.305492:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.305500:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.305509:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.305514:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.305585:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.305606:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.305615:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd92289/0xdaa289fda243e6a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.305645:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.305647:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.305649:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.307140:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.307150:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307165:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.307169:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.307174:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307185:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307210:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307240:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307263:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.307276:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.307282:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307289:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.307294:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307302:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307314:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307321:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e6af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.307338:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.307340:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.307341:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.311670:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.311686:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.311704:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.311710:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.311716:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.311735:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.311747:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.311755:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.311780:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480226.312346:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.312353:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.312374:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.312378:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.312382:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.312392:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.312400:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.312408:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.312421:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789480226.312904:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480226.312913:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.312922:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.312926:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.312943:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.312963:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.312971:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000475745b5/0xdaa289fda243e6b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.312994:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.312998:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.313004:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.313007:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.313013:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.313023:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.313030:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7974fb5/0xdaa289fda243e6bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.313058:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.313060:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.313061:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.314052:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.314064:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.314079:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.314083:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.314088:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.314101:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.314126:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.314134:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.314154:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.314545:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.314559:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.314567:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.314571:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.314580:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.314598:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.314607:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b7da2bb/0xdaa289fda243e6c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.314628:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.314630:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.314631:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.316776:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.317132:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.317144:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.317161:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.317166:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.317173:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480226.317591:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.317599:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317609:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.317611:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.317616:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317638:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317649:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317657:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317674:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.317686:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.317690:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317698:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.317702:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317710:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317727:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317734:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e6d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.317757:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.317759:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.317761:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.318157:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318172:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318180:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318228:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480226.318237:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.318242:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318249:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.318252:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318260:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318273:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318281:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e6cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.318298:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.318299:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.318301:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.319033:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.319041:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319053:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.319063:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.319069:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319082:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319092:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319099:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319114:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.319122:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.319126:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319133:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.319137:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319145:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319156:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319176:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000448ddad5/0xdaa289fda243e6d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319221:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.319223:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.319225:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.319738:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.319745:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319753:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.319757:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.319760:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319769:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319777:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319784:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.319797:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480226.321096:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.321108:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.321120:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.321131:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.321140:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.321156:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.321164:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd886c7/0xdaa289fda243e6e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.321183:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.321185:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.321186:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.323956:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.323975:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.323993:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.323998:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.324005:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324020:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324031:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324039:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324058:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.324072:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.324078:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324087:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.324091:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324100:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324123:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324131:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e00dc448/0xdaa289fda243e6e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324151:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.324152:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.324154:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.324487:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.324494:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324503:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.324506:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.324510:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324523:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324759:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324766:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789480226.324898:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.324904:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324912:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.324915:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.324919:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324928:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324935:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324943:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.324962:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.325132:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480226.325141:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480226.325146:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325155:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047be00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.325165:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325174:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325186:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325215:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e6f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325234:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.325238:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325243:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.325246:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325252:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325262:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325268:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7557b04/0xdaa289fda243e6ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325289:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.325291:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.325293:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.325499:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.325505:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325513:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.325517:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.325521:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325531:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325539:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325546:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325559:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.325566:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.325570:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325586:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.325589:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325596:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325607:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325614:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e6fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.325627:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.325629:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.325630:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.330498:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.335571:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.335588:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.335607:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.335612:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.335619:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.335634:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.335657:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.335666:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.335687:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789480226.336737:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.336747:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.336759:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.336763:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.336768:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.336780:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.336789:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.336797:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.336812:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789480226.337141:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480226.337149:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337158:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.337162:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337173:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337209:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337218:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e703 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337239:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.337251:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337258:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.337261:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337270:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337282:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337289:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243e70a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.337304:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.337305:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.337307:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.338466:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.338639:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.338648:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.338677:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.338682:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.338687:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.338699:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.338708:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.338716:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.338747:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.339427:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.339436:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.339445:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.339450:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.339482:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.339498:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.339505:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009725a1e5/0xdaa289fda243e711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.339523:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.340180:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.340183:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.341036:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.341047:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.341064:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.341069:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.341074:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.341087:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.341110:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.341118:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.341147:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.341656:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.341665:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.341673:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.341678:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.341686:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.341703:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.341711:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008131c9f0/0xdaa289fda243e718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.341730:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.341731:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.341733:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.343214:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.343227:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.343242:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.343247:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.343252:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.343279:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.343289:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.343297:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.344265:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.344274:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.344284:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.344289:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.344299:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.344316:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.344437:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 0 blwis in pool 00002000:00010000:2.0:1789480226.345105:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.345113:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.345124:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.345128:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.345133:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.345144:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.345152:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.345166:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.345184:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480226.345622:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6236d48/0xdaa289fda243e71f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345644:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.345656:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345663:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.345667:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345676:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345692:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345700:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186052c0/0xdaa289fda243e726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.345714:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.345716:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.345719:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.346309:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.347151:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.347164:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.347178:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.347182:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.347225:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.347239:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.347249:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.347257:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.347277:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789480226.347851:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.347859:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.347870:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.347873:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.347878:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348004:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.348013:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348030:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047be00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.348035:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348045:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348061:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348068:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc05bc73/0xdaa289fda243e72d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.348091:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.348093:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.348094:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.348629:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.348642:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.348662:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.348675:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789480226.349166:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.349173:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.349182:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480226.349186:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.349215:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.349241:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.349248:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7974fb5/0xdaa289fda243e734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.349269:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.349271:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.349273:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.354108:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.354126:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.354154:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.354158:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.354165:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.354180:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.354237:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.354247:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.354271:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480226.355127:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.355136:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.355148:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.355153:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.355158:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.355169:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.355282:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.355291:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.355306:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789480226.356403:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789480226.356415:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356426:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.356431:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356442:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356472:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356481:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000631d0828/0xdaa289fda243e73b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356506:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.356510:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356541:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.356544:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356553:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356564:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356571:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a898f1a7/0xdaa289fda243e742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.356588:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.356590:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.356591:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.358702:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.358720:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.358738:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.358743:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.358750:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.358766:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359616:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359630:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359661:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480226.359679:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.359684:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359692:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.359697:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359707:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359724:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359732:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.359759:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.359767:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.359769:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.362513:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1789480226.363268:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.363279:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.363297:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.363302:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.363310:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363422:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363434:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.363438:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.363442:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363471:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363484:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363493:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.363979:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.364000:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.364007:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.364016:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047ae00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.364020:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.364030:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.364049:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.364056:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028252e79/0xdaa289fda243e750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.364081:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.364083:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.364084:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.364669:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.364682:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.364690:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.364804:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.366044:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.366058:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366071:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.366086:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366097:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366117:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366125:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008891b05d/0xdaa289fda243e757 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366152:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.366154:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.366155:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.366284:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.366291:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.366304:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.366309:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.366315:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.368452:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.368478:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.368493:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.368513:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.369083:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.369092:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.369102:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.369106:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.369116:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.369135:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.369142:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003709f361/0xdaa289fda243e75e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.369167:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.369168:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.369170:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.370140:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.370367:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.370377:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.370392:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.370397:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.370403:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.370416:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.370426:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.370435:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.370475:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.372058:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.372080:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.372093:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.372098:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.372109:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.372128:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.372135:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d47bf84/0xdaa289fda243e765 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.372156:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.372158:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.372160:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.373026:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.373035:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.373048:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.373052:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.373058:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.373085:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.373094:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.373103:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.373119:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480226.374483:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.374493:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.374506:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.374510:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.374515:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.375304:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.375943:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.375969:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.375999:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480226.376018:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480226.376025:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376033:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.376038:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376048:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376069:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376076:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ff49e3f/0xdaa289fda243e76c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376102:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.376106:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376124:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.376127:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376135:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376146:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376153:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da9f9523/0xdaa289fda243e773 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.376167:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.376169:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.376171:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.376237:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.376340:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.376347:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.376358:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.376362:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.376368:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.376380:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.376389:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.376396:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.376414:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.378468:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.378481:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.378495:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.378500:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.378512:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.378549:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.378558:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bde33a00/0xdaa289fda243e77a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.378583:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.378585:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.378587:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.382481:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.382500:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.382526:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.382532:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.382539:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.382554:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.382566:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.382574:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.382611:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480226.383290:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.383300:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.383310:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047bc00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.383325:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.383348:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.383366:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.383373:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6dc9910/0xdaa289fda243e781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.383391:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.383393:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.383395:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.384375:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.384385:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.384400:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.384405:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.384410:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.384423:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.384432:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.384449:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.384477:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.386948:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.386966:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.386981:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecdc00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.386986:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.386996:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387017:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387024:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33d5a65/0xdaa289fda243e788 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387043:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.387045:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.387047:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.387116:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.387124:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.387137:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.387150:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.387156:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.387170:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.387180:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.387218:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.387242:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.387649:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.387656:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387664:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.387676:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387685:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387698:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387705:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a564d47b/0xdaa289fda243e78f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.387722:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.387724:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.387726:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789480226.390513:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1789480226.390561:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789480226.390567:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789480226.391282:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17896:x1876405527984512:12345-0@lo:5:osp-pre-1-1.0 Request processed in 108624us (110541us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789480226.391296:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480226.391365:0:17896:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789480226.391373:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1876405527984512:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789480226.391390:0:17896:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1789480226.391448:0:17896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1876405527984640:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789480226.391496:0:17896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.391522:0:17896:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789480226.391553:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984640 00000100:00100000:3.0:1789480226.391560:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984640 00000100:00100000:3.0:1789480226.391604:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480226.391612:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1876405527984640:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789480226.391655:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1876405527984640:12345-0@lo:900:osp-pre-1-1.0 Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.391661:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789480226.391691:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6987da9180 x1876405527984640/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789480242 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480226.391703:0:17896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1876405527984640:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1789480226.391801:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.391815:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.391834:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.391840:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.391847:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.391864:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.391888:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.391896:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.391927:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480226.392271:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.392283:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392298:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.392303:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.392309:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392334:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392343:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392359:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392378:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789480226.392389:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480226.392396:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392404:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.392408:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392418:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392435:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392443:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243e796 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392471:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.392475:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392496:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.392499:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392506:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392518:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392533:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9f9523/0xdaa289fda243e79d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.392551:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.392553:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.392555:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.393004:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.393014:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.393029:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.393034:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.393040:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393053:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480226.393053:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.393068:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.393076:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.393107:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.393172:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.393179:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393217:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bd400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.393221:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393231:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393256:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393263:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dab69c6/0xdaa289fda243e7a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393284:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.393287:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.393290:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.393397:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.393404:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393414:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.393418:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.393422:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393433:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393442:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393449:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.393481:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.393644:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.393650:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393659:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecde00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.393662:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393670:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393682:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393690:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000078be1af/0xdaa289fda243e7ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.393716:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.393718:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.393720:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.394513:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.394533:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.394546:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.394551:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.394556:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.394578:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.394587:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.394595:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.394615:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480226.394847:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.394858:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.394873:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.394877:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.394883:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.394897:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.394907:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480226.394908:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.394917:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.394925:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.394930:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.394938:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.394954:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.394968:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.394969:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.394985:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000be3ab26/0xdaa289fda243e7b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395005:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.395024:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395031:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.395043:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395052:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395063:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395070:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bde33a00/0xdaa289fda243e7b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.395088:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.395090:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.395092:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.395229:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789480226.396064:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789480226.396073:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.396086:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=595s v=(0 0) 00010000:00010000:3.0:1789480226.396091:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480226.396095:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.396107:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.396117:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.396139:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.396155:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.396538:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.396546:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.396553:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.396557:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.396565:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.396579:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.396592:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b3743ff/0xdaa289fda243e7c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.396608:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.396610:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.396611:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.396815:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.396827:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.396843:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.396858:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.396865:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.396879:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.396888:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.396895:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.396910:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789480226.398796:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.398809:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.398826:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.398830:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.398835:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.398849:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.398858:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.398876:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.398903:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789480226.399338:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.399344:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.399353:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.399356:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.399360:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.399370:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.399378:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.399385:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.399393:0:18658:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1789480226.399501:0:18658:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1789480226.399673:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17179:x1876405527983744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 136400us (137067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.399691:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480226.399752:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1876405527983744:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789480226.399767:0:17179:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1789480226.399814:0:17179:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1876405527984768:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789480226.399848:0:17179:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480226.399872:0:17179:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6986b513c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789480226.399892:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984768 00000100:00100000:1.0:1789480226.399899:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984768 00000100:00100000:1.0:1789480226.399937:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789480226.399945:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17179:x1876405527984768:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789480226.399981:0:18659:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789480226.402131:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789480226.402148:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402165:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc400 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.402170:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402183:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402223:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402231:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d47bf84/0xdaa289fda243e7c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402262:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789480226.402266:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402290:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bde00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.402294:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402302:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402313:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402918:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243e7ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402941:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.402945:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402952:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.402956:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402963:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402975:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.402990:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dd92289/0xdaa289fda243e7d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.403004:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.403006:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.403008:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.403519:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789480226.404419:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789480226.404434:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.404461:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=595s v=(0 0) 00010000:00010000:1.0:1789480226.404468:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480226.404476:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.404492:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.404504:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.404529:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.404560:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.404705:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.404715:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.404728:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a80031200 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.404733:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.404744:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.404764:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.404773:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a49326e8/0xdaa289fda243e7dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.404806:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.404808:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.404810:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789480226.405985:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789480226.405998:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406013:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=595s v=(0 0) 00010000:00010000:0.0:1789480226.406019:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789480226.406026:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406052:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406062:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406070:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406093:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789480226.406106:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480226.406112:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406120:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5db800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480226.406124:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406133:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406147:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406155:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000475745b5/0xdaa289fda243e7e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.406182:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.406184:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480226.406186:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.408627:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.408642:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408659:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.408665:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.408672:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408687:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408698:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408706:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408728:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.408742:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.408748:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408757:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b800 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.408762:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408785:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408883:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408891:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff49e3f/0xdaa289fda243e7ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.408914:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.408916:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.408918:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.409709:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.409718:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.409731:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.409735:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.409740:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.409752:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.409762:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.409788:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.410444:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480226.410637:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.410645:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.410654:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047b600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.410659:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.410668:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.410685:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.410692:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003709f361/0xdaa289fda243e7f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.410714:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.410716:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.410717:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.411470:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.411479:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.411492:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.411497:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.411502:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.411514:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.411891:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.411901:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.411963:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789480226.413580:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.413594:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.413619:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.413623:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.413629:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.413644:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.413653:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.413662:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480226.413751:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17179:x1876405527984768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13794us (13890us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789480226.413771:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789480226.413879:0:17179:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a78a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17179:1876405527984768:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789480226.413896:0:17179:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1789480226.414474:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789480226.414496:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.414507:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047ae00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.414511:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.414579:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.414599:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.414606:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028252e79/0xdaa289fda243e7f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415462:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789480226.415482:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789480226.415488:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415498:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047ba00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480226.415502:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415510:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415612:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415620:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58d5314/0xdaa289fda243e7ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.415641:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.415643:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.415645:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.415902:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.417184:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.417233:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.417249:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.417253:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.417259:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.417282:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.417292:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.417300:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.417346:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789480226.418038:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.418049:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.418060:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.418064:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.418076:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.418108:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.418116:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b37db7d/0xdaa289fda243e806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.418141:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.418143:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.418145:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789480226.418996:0:19103:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789480226.419120:0:19103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.419136:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=595s v=(0 0) 00010000:00010000:2.0:1789480226.419141:0:19103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480226.419147:0:19103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.419160:0:19103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.419169:0:19103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.419176:0:19103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.419337:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789480226.419345:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.419353:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480226.419357:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.419365:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.419378:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.419388:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.419390:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480226.419391:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480226.419724:0:19103:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789480226.419730:0:19103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003815ba57/0xdaa289fda243e80d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1789480226.419925:0:19103:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1789480226.420057:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17177:x1876405527984000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 156760us (157169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480226.420078:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789480226.420735:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1876405527984000:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789480226.420756:0:17177:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1789480226.420893:0:17177:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1876405527984896:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789480226.420943:0:17177:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480226.420982:0:17177:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6987da7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480226.421042:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527984896 00000100:00100000:0.0:1789480226.421050:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527984896 00000100:00100000:0.0:1789480226.421147:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789480226.421158:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17177:x1876405527984896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789480226.421241:0:18657:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1789480226.458343:0:18653:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1789480226.458390:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789480226.458897:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17177:x1876405527984896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 37733us (37946us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789480226.458913:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789480226.458942:0:17177:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789480226.458955:0:17177:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17177:1876405527984896:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789480226.458973:0:17177:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 10000000:01000000:2.0:1789480226.949996:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789480226.950004:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a698885a800 from 10 10000000:01000000:2.0:1789480226.950009:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789480226.950060:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.950073:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480226.950086:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480226.950113:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480226.950179:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480226.950247:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab981b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789480226.951724:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985024 00000100:00100000:1.0:1789480226.951736:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985024 00000100:00100000:1.0:1789480226.951797:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789480226.951808:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527985024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480226.951828:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480226.951847:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a80030e00/0xdaa289fda243e81b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e814 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.951879:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a80030e00/0xdaa289fda243e81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e814 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.951891:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a80030e00/0xdaa289fda243e81b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e814 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480226.951913:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030e00, rc 0) 00000100:00100000:1.0:1789480226.951973:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527985024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.951979:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789480226.954692:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480226.954721:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e81b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.954734:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e81b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480226.954808:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480226.954871:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480226.954913:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417180 going to sleep for 11 seconds 00000100:00100000:1.0:1789480226.955012:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985152 00000100:00100000:1.0:1789480226.955019:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985152 00000100:00100000:1.0:1789480226.955068:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789480226.955078:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527985152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789480226.955101:0:17145:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789480226.955118:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789480226.955121:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789480226.955258:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527985152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480226.955265:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789480226.955681:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480226.955740:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480226.955749:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e81b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.955759:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b800/0xdaa289fda243e814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e81b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480226.955779:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789480226.955782:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a6988485000 from 10 10000000:01000000:0.0:1789480226.955785:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789480226.955813:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.955821:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.955831:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480226.955844:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480226.955873:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480226.955900:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480226.955955:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985280 00000100:00100000:3.0:1789480226.955960:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985280 00000100:00100000:3.0:1789480226.956001:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789480226.956008:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527985280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480226.956018:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480226.956031:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecc200/0xdaa289fda243e829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e822 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.956054:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecc200/0xdaa289fda243e829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e822 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.956063:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecc200/0xdaa289fda243e829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e822 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480226.956072:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc200, rc 0) 00000100:00100000:3.0:1789480226.956101:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527985280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.956113:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789480226.956564:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480226.956578:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e829 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.956585:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e829 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480226.956625:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789480226.956657:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480226.956685:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb417180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480226.956736:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985408 00000100:00100000:3.0:1789480226.956741:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985408 00000100:00100000:3.0:1789480226.956773:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789480226.956780:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527985408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789480226.956792:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789480226.956807:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789480226.956810:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789480226.956892:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527985408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480226.956900:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789480226.957000:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527985408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789480226.957044:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789480226.957054:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e829 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480226.957063:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5db800/0xdaa289fda243e822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e829 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480227.013553:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480227.525393:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527985536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789480227.525474:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480227.525557:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985536 00000100:00100000:1.0:1789480227.525565:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985536 00000100:00100000:1.0:1789480227.525851:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789480227.525862:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527985536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789480227.525890:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789480227.525943:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527985536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480227.525950:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789480227.525972:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789480227.526495:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527985536:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789480228.036622:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480228.549636:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480228.549657:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527985664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480228.549716:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480228.549746:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789480228.549753:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527985792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480228.549774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480228.549794:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985664 00000100:00100000:2.0:1789480228.549801:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985664 00000100:00100000:2.0:1789480228.549845:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985792 00000100:00100000:2.0:1789480228.549847:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985792 00000100:00100000:2.0:1789480228.549860:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789480228.549867:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527985664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480228.549900:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789480228.549943:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527985664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480228.549949:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789480228.549963:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789480228.549969:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527985792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480228.549982:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789480228.550004:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527985792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480228.550010:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789480228.550046:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527985792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480228.550074:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527985664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789480229.064976:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480230.085075:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480231.110007:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480231.621058:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789480231.621094:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527985920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480231.621160:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621260:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527985920 00000100:00100000:0.0:1789480231.621268:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527985920 00000100:00100000:0.0:1789480231.621327:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789480231.621336:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527985920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480231.621366:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480231.621413:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527985920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480231.621419:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789480231.621452:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480231.621559:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527986048:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621595:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621618:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527986560:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621641:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621666:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527987072:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621691:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621724:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789480231.621729:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527986176:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621751:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621767:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527986688:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621786:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527987200:0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621826:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480231.621855:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986048 00000100:00100000:0.0:1789480231.621859:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986048 00000100:00100000:0.0:1789480231.621884:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789480231.621891:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3645:x1876405527986048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.621926:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3645:x1876405527986048:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480231.621932:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789480231.621957:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986560 00000100:00100000:0.0:1789480231.621961:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986560 00000100:00100000:0.0:1789480231.621984:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986176 00000100:00100000:0.0:1789480231.621987:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986176 00000100:00100000:0.0:1789480231.621999:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789480231.622006:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527986560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.622040:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527986560:12345-0@lo:400:kworker.0 Request processed in 34us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480231.622046:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789480231.622057:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789480231.622062:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527986176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.622087:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527986176:12345-0@lo:400:kworker.0 Request processed in 25us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480231.622103:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789480231.622122:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987072 00000100:00100000:0.0:1789480231.622126:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987072 00000100:00100000:0.0:1789480231.622156:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987200 00000100:00100000:0.0:1789480231.622160:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987200 00000100:00100000:0.0:1789480231.622177:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789480231.622183:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527987072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.622232:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527987072:12345-0@lo:400:kworker.0 Request processed in 49us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480231.622238:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789480231.622541:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986688 00000100:00100000:3.0:1789480231.622545:0:19538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986688 00000100:00100000:3.0:1789480231.622701:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789480231.622709:0:19538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527986688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480231.622743:0:19538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527986688:12345-0@lo:400:kworker.0 Request processed in 36us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480231.622748:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789480231.623024:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527986432:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527986944:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623109:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623121:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527987456:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623158:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789480231.623163:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527986304:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623183:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623237:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527986816:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623259:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623274:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527987328:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.623297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.623403:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986432 00000100:00100000:2.0:1789480231.623408:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986432 00000100:00100000:0.0:1789480231.623529:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789480231.623541:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527987200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480231.623579:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876405527987200:12345-0@lo:400:kworker.0 Request processed in 43us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480231.623639:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986304 00000100:00100000:3.0:1789480231.623643:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986304 00000100:00100000:3.0:1789480231.623670:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986816 00000100:00100000:3.0:1789480231.623673:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986816 00000100:00100000:3.0:1789480231.623693:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480231.623700:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527986304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480231.623738:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527986304:12345-0@lo:400:kworker.0 Request processed in 39us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480231.623751:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789480231.623763:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789480231.623768:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527986816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480231.623795:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527986816:12345-0@lo:400:kworker.0 Request processed in 27us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480231.623801:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789480231.624073:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527986944 00000100:00100000:2.0:1789480231.624088:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527986944 00000100:00100000:2.0:1789480231.624105:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987456 00000100:00100000:2.0:1789480231.624107:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987456 00000100:00100000:2.0:1789480231.624119:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987328 00000100:00100000:2.0:1789480231.624121:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987328 00000100:00100000:2.0:1789480231.624132:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480231.624137:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527986432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624170:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527986432:12345-0@lo:400:kworker.0 Request processed in 33us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.624176:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789480231.624222:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789480231.624229:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527986944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624258:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527986944:12345-0@lo:400:kworker.0 Request processed in 30us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.624264:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789480231.624276:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789480231.624281:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527987456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624307:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527987456:12345-0@lo:400:kworker.0 Request processed in 26us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.624312:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789480231.624334:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789480231.624339:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527987328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624367:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1876405527987328:12345-0@lo:400:kworker.0 Request processed in 28us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.624373:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789480231.624405:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480231.624409:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480231.624412:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480231.624414:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480231.624475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527985920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480231.624512:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527986304:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624520:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527986816:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb56fb80 x1876405527987328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624541:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1876405527987328:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624551:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aad80 x1876405527986432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624559:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527986432:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624569:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aaa00 x1876405527986944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624576:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527986944:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624584:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb56f480 x1876405527987456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624603:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527987456:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624632:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527987584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789480231.624666:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.624701:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527986176:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624713:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527986688:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624722:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812ab100 x1876405527987200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624730:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1876405527987200:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624738:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527986048:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624748:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527986560:0@lo:400:kworker.0 00010000:00080000:2.0:1789480231.624758:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aa300 x1876405527987072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480231.624765:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527987072:0@lo:400:kworker.0 00000100:00100000:2.0:1789480231.624857:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480231.624863:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527987712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480231.624892:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480231.626369:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987584 00000100:00100000:2.0:1789480231.626380:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987584 00000100:00100000:2.0:1789480231.626412:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987712 00000100:00100000:2.0:1789480231.626415:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987712 00000100:00100000:2.0:1789480231.626445:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480231.626456:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527987584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789480231.626496:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789480231.626566:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527987584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.626572:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480231.626590:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480231.626596:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527987712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480231.626619:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789480231.626648:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876405527987712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480231.626654:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480231.626699:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527987712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480231.626714:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6987da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527987584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480231.627465:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000001:02000400:3.0:1789480232.034786:0:19828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789480232.135017:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789480232.141861:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:3.0:1789480232.452808:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789480232.648605:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480232.648640:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527987840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789480232.648707:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480232.648757:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987840 00000100:00100000:0.0:1789480232.648765:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987840 00000100:00100000:0.0:1789480232.648816:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480232.648825:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527987840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480232.648851:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480232.648894:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527987840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480232.649412:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789480232.649474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527987840:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1789480232.910680:0:19880:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789480232.910886:0:19880:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789480233.156346:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480233.669873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480233.669938:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480233.670944:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789480233.670958:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527988096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480233.670997:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480233.671946:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527987968 00000100:00100000:1.0:1789480233.671957:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527987968 00000100:00100000:1.0:1789480233.672010:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988096 00000100:00100000:1.0:1789480233.672013:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988096 00000100:00100000:1.0:1789480233.672031:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789480233.672040:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527987968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480233.672080:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789480233.672155:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527987968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480233.672162:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789480233.672323:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789480233.672331:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527988096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480233.672350:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480233.672383:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527988096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480233.672389:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789480233.672527:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1a79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527987968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789480233.672565:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527988096:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1789480233.938827:0:19930:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789480233.939039:0:19930:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789480234.180701:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480234.251687:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.251804:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968000 00000100:00100000:1.0:1789480234.251816:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968000 00000100:00100000:1.0:1789480234.251999:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:1.0:1789480234.252007:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1876405507968000:12345-192.168.206.44@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789480234.252039:0:17147:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ea11d651-dcbe-4d90-aa74-3e752427f416@192.168.206.44@tcp t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:1.0:1789480234.252070:0:17147:0:(genops.c:1384:class_connect()) connect: client ea11d651-dcbe-4d90-aa74-3e752427f416, cookie 0xdaa289fda243e830 00000100:00080000:1.0:1789480234.252286:0:17147:0:(import.c:65:import_set_state_nolock()) ffff8a6986872800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480234.252398:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+5:2398:x1876405507968000:12345-192.168.206.44@tcp:250:mount.lustre.0 Request processed in 389us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.252533:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 115 00000100:00100000:1.0:1789480234.267663:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.268000:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968128 00000100:00100000:2.0:1789480234.268295:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968128 00000100:00100000:2.0:1789480234.268431:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:2.0:1789480234.268444:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+5:14907:x1876405507968128:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480234.268463:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480234.268484:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243e837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e90 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.268517:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243e837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e90 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.268545:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047b400/0xdaa289fda243e837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e90 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.268556:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b400, rc 0) 00000100:00100000:2.0:1789480234.268621:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+6:14907:x1876405507968128:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 180us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.268629:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:2.0:1789480234.275985:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.276156:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968256 00000100:00100000:1.0:1789480234.276178:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968256 00000100:00100000:1.0:1789480234.276318:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:1.0:1789480234.276329:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+6:14907:x1876405507968256:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480234.276765:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+6:14907:x1876405507968256:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 428us (779us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789480234.276774:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:3.0:1789480234.281595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.281831:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968384 00000100:00100000:2.0:1789480234.281844:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968384 00000100:00100000:2.0:1789480234.281915:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:2.0:1789480234.281927:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+6:14907:x1876405507968384:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480234.281945:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480234.281965:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243e83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2e97 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.281994:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243e83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e97 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.282005:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047bc00/0xdaa289fda243e83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2e97 expref: 7 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.282014:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047bc00, rc 0) 00000100:00100000:2.0:1789480234.282090:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+7:14907:x1876405507968384:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 165us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.282097:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:2.0:1789480234.291229:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.291396:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968512 00000100:00100000:1.0:1789480234.291408:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968512 00000100:00100000:1.0:1789480234.291484:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:1.0:1789480234.291495:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+7:14907:x1876405507968512:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480234.291688:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14907:x1876405507968512:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 195us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.291696:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:1.0:1789480234.295884:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.297479:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968640 00000100:00100000:0.0:1789480234.297495:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968640 00000100:00100000:0.0:1789480234.297623:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:0.0:1789480234.297635:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14907:x1876405507968640:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789480234.297850:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14907:x1876405507968640:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 217us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.297858:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:3.0:1789480234.303228:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.303529:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968768 00000100:00100000:2.0:1789480234.303541:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968768 00000100:00100000:2.0:1789480234.303605:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:2.0:1789480234.303614:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507968768:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480234.303791:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507968768:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 177us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.303798:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:2.0:1789480234.331076:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.333545:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507968896 00000100:00100000:0.0:1789480234.333565:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507968896 00000100:00100000:0.0:1789480234.333655:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:0.0:1789480234.333667:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507968896:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480234.333887:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507968896:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 220us (2825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.333895:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:3.0:1789480234.344571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.346254:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969024 00000100:00100000:1.0:1789480234.346271:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969024 00000100:00100000:1.0:1789480234.346354:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:1.0:1789480234.346366:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507969024:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480234.346587:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14925:x1876405507969024:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 223us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.346594:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:3.0:1789480234.351575:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.351701:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969152 00000100:00100000:2.0:1789480234.351713:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969152 00000100:00100000:2.0:1789480234.351787:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:2.0:1789480234.351798:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+8:14907:x1876405507969152:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480234.351817:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480234.351837:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243e845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ec8 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.351962:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243e845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ec8 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.351975:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a000/0xdaa289fda243e845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ec8 expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.351984:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a000, rc 0) 00000100:00100000:2.0:1789480234.352052:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+9:14907:x1876405507969152:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 256us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.352059:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:2.0:1789480234.356968:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.357093:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969280 00000100:00100000:1.0:1789480234.357106:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969280 00000100:00100000:1.0:1789480234.357273:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:1.0:1789480234.357285:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+9:14907:x1876405507969280:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789480234.357333:0:17147:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789480234.357354:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789480234.357359:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789480234.357362:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789480234.357365:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789480234.357367:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789480234.360121:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+9:14907:x1876405507969280:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 2824us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.360137:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:3.0:1789480234.363642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.363973:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969408 00000100:00100000:2.0:1789480234.363986:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969408 00000100:00100000:2.0:1789480234.364054:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:2.0:1789480234.364066:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+9:14907:x1876405507969408:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480234.364083:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480234.364105:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ecf expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.364137:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.364148:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480234.364157:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047ba00, rc 0) 00000100:00100000:2.0:1789480234.364385:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14907:x1876405507969408:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 320us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.364393:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:2.0:1789480234.369978:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.370793:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969536 00000100:00100000:1.0:1789480234.370807:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969536 00000100:00100000:1.0:1789480234.370885:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:1.0:1789480234.370897:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69878dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14907:x1876405507969536:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789480234.371092:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69878dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14907:x1876405507969536:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 196us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.371100:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:3.0:1789480234.375626:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.383534:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969664 00000100:00100000:2.0:1789480234.383552:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969664 00000100:00100000:2.0:1789480234.383640:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:2.0:1789480234.383651:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14907:x1876405507969664:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789480234.383866:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14907:x1876405507969664:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 215us (8475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.383874:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:3.0:1789480234.389570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.390306:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969792 00000100:00100000:0.0:1789480234.390319:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969792 00000100:00100000:0.0:1789480234.390410:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:0.0:1789480234.390431:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14931:x1876405507969792:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789480234.390613:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14931:x1876405507969792:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 184us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.390622:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:3.0:1789480234.404662:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.410379:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507969920 00000100:00100000:1.0:1789480234.410397:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507969920 00000100:00100000:1.0:1789480234.410505:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:1.0:1789480234.410518:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14931:x1876405507969920:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789480234.411040:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+10:14931:x1876405507969920:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 522us (6657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.411050:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:3.0:1789480234.417168:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480234.417395:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.417857:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970048 00000100:00100000:2.0:1789480234.417872:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970048 00000100:00100000:2.0:1789480234.417930:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970304 00000100:00100000:2.0:1789480234.417934:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970304 00000100:00100000:2.0:1789480234.417968:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480234.417976:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876405507970048:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789480234.418010:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 4e1b46fe-7168-46d1-8c19-6654dff86af2@192.168.206.44@tcp t0 exp 0000000000000000 cur 603 last 0 00000100:00100000:3.0:1789480234.418015:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1789480234.418021:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1876405507970304:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789480234.418038:0:18681:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 4e1b46fe-7168-46d1-8c19-6654dff86af2@192.168.206.44@tcp t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:3.0:1789480234.418078:0:18681:0:(genops.c:1384:class_connect()) connect: client 4e1b46fe-7168-46d1-8c19-6654dff86af2, cookie 0xdaa289fda243e85a 00000020:00000080:2.0:1789480234.418078:0:17154:0:(genops.c:1384:class_connect()) connect: client 4e1b46fe-7168-46d1-8c19-6654dff86af2, cookie 0xdaa289fda243e853 00000004:00100000:3.0:1789480234.418111:0:18681:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000004:00100000:2.0:1789480234.418111:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789480234.418370:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6986ac2000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789480234.418409:0:18681:0:(import.c:65:import_set_state_nolock()) ffff8a69869fc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480234.420537:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2398:x1876405507970048:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 2543us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.420553:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1789480234.420908:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2398:x1876405507970304:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 2884us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480234.420919:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1789480234.426735:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480234.426789:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.426841:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970432 00000100:00100000:1.0:1789480234.426854:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970560 00000100:00100000:0.0:1789480234.426858:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970432 00000100:00100000:1.0:1789480234.426859:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970560 00000100:00100000:1.0:1789480234.426947:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:1.0:1789480234.426979:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507970560:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789480234.427026:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480234.427137:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507970560:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.427144:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1789480234.427617:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480234.427772:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970176 00000100:00100000:1.0:1789480234.427781:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970176 00000100:00100000:1.0:1789480234.427820:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1789480234.427830:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:0:x1876405507970176:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789480234.427850:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480234.427900:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:0:x1876405507970176:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.427907:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:2.0:1789480234.430184:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480234.430210:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480234.430461:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789480234.430481:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:0:x1876405507970432:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789480234.430527:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789480234.430645:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:0:x1876405507970432:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 173us (3919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.430672:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789480234.433869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.434038:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970688 00000100:00100000:2.0:1789480234.434054:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970688 00000100:00100000:2.0:1789480234.434143:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:2.0:1789480234.434155:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507970688:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789480234.434450:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507970688:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 297us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480234.434459:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:2.0:1789480234.442463:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.442507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.442544:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.442894:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970816 00000100:00100000:0.0:1789480234.442911:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970816 00000100:00100000:0.0:1789480234.442978:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507970944 00000100:00100000:0.0:1789480234.442982:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507970944 00000100:00100000:0.0:1789480234.443017:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789480234.443027:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876405507970816:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789480234.443072:0:19103:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 4e1b46fe-7168-46d1-8c19-6654dff86af2@192.168.206.44@tcp t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:0.0:1789480234.443114:0:19103:0:(genops.c:1384:class_connect()) connect: client 4e1b46fe-7168-46d1-8c19-6654dff86af2, cookie 0xdaa289fda243e861 00000100:00100000:3.0:1789480234.443120:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971072 00002000:00100000:0.0:1789480234.443127:0:19103:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4e1b46fe-7168-46d1-8c19-6654dff86af2/ffff8a6987e05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1789480234.443134:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971072 00002000:00100000:0.0:1789480234.443154:0:19103:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789480234.443280:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1789480234.443287:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876405507970944:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789480234.443306:0:18659:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 4e1b46fe-7168-46d1-8c19-6654dff86af2@192.168.206.44@tcp t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:1.0:1789480234.443329:0:18659:0:(genops.c:1384:class_connect()) connect: client 4e1b46fe-7168-46d1-8c19-6654dff86af2, cookie 0xdaa289fda243e868 00002000:00100000:1.0:1789480234.443333:0:18659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4e1b46fe-7168-46d1-8c19-6654dff86af2/ffff8a6986870000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480234.443345:0:18659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789480234.443434:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1789480234.443448:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507971072:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789480234.443550:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507971072:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 102us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480234.443560:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00002000:00080000:1.0:1789480234.443590:0:18659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789480234.443626:0:18659:0:(import.c:65:import_set_state_nolock()) ffff8a6986872000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480234.443689:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2398:x1876405507970944:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 399us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480234.443696:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00002000:00080000:0.0:1789480234.444331:0:19103:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789480234.444360:0:19103:0:(import.c:65:import_set_state_nolock()) ffff8a6987e04000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789480234.444396:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2398:x1876405507970816:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 1370us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.444404:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789480234.450151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480234.450539:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971200 00000100:00100000:2.0:1789480234.450552:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971200 00000100:00100000:2.0:1789480234.450671:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789480234.450683:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507971200:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789480234.455949:0:17155:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5041us 00000004:00200000:3.0:1789480234.473515:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789480234.474084:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14907:x1876405507971200:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 23394us (23938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.474103:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1789480234.600167:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480234.601045:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971328 00000100:00100000:0.0:1789480234.601059:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971328 00000100:00100000:0.0:1789480234.601234:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1789480234.601247:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:14954:x1876405507971328:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:0.0:1789480234.601270:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480234.601301:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e86f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f00 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601379:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601393:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601409:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480234.601475:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789480234.601479:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480234.601523:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601575:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e86f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f00 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601600:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f00 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480234.601609:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:0.0:1789480234.601612:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789480234.601616:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da800, rc 0) 00000100:00100000:0.0:1789480234.601701:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:14954:x1876405507971328:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 457us (1552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480234.601709:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000040:00080000:0.0:1789480234.762756:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789480235.204655:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480236.230245:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480236.564764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.564865:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971456 00000100:00100000:2.0:1789480236.564884:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971456 00000100:00100000:2.0:1789480236.564960:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1789480236.564970:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15006:x1876405507971456:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:2.0:1789480236.565013:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:0.0:1789480236.565049:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789480236.565104:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15006:x1876405507971456:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.565111:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1789480236.567927:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480236.568521:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971584 00000100:00100000:3.0:1789480236.568534:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971584 00000100:00100000:3.0:1789480236.568712:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:3.0:1789480236.568725:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971584:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:3.0:1789480236.568993:0:18681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789480236.569118:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971584:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 395us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.569127:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00080000:0.0:1789480236.570093:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480236.572630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480236.573675:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971712 00000100:00100000:0.0:1789480236.573691:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971712 00000100:00100000:0.0:1789480236.573797:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:0.0:1789480236.573808:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971712:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:0.0:1789480236.573846:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480236.573954:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971712:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 148us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.573962:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:2.0:1789480236.574092:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480236.577559:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480236.577803:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971840 00000100:00100000:0.0:1789480236.577814:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971840 00000100:00100000:0.0:1789480236.577916:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1789480236.577929:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971840:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:0.0:1789480236.577967:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1789480236.578139:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480236.578423:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15006:x1876405507971840:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 495us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.578512:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1789480236.741143:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789480236.741173:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527988224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480236.741291:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.741559:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789480236.741571:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527988352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480236.741605:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.741653:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988224 00000100:00100000:0.0:1789480236.741663:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988224 00000100:00100000:0.0:1789480236.741715:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988352 00000100:00100000:0.0:1789480236.741719:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988352 00000100:00100000:0.0:1789480236.741737:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480236.741746:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527988224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480236.741770:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789480236.741816:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876405527988224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.741823:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789480236.741976:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789480236.741984:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527988352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480236.741995:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480236.742031:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527988352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.742037:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789480236.742084:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527988352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789480236.742506:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789480236.742517:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527988480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480236.742563:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480236.742594:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988480 00000100:00100000:3.0:1789480236.742599:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988480 00000100:00100000:3.0:1789480236.742627:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480236.742634:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527988480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480236.742654:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789480236.742689:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527988480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.742695:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789480236.742727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ac1c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527988480:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789480236.743144:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480236.743149:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480236.743182:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789480236.743239:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1876405527988224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480236.743479:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527988736:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743524:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480236.743565:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527989248:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743597:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480236.743615:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527989760:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743637:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480236.743664:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789480236.743670:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527988608:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743699:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480236.743720:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527989120:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743744:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480236.743759:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527989632:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.743783:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480236.744388:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988736 00000100:00100000:2.0:1789480236.744397:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988736 00000100:00100000:2.0:1789480236.744482:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480236.744492:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527988736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.744562:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527988736:12345-0@lo:400:kworker.0 Request processed in 71us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.744585:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480236.744612:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988608 00000100:00100000:2.0:1789480236.744616:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988608 00000100:00100000:2.0:1789480236.744652:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789480236.744660:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527988608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.744694:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527988608:12345-0@lo:400:kworker.0 Request processed in 35us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.744700:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789480236.744731:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989248 00000100:00100000:2.0:1789480236.744735:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989248 00000100:00100000:2.0:1789480236.744759:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989760 00000100:00100000:2.0:1789480236.744762:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989760 00000100:00100000:2.0:1789480236.744788:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989632 00000100:00100000:2.0:1789480236.744791:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989632 00000100:00100000:2.0:1789480236.744807:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789480236.744811:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527989248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.744841:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527989248:12345-0@lo:400:kworker.0 Request processed in 30us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.744846:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789480236.744858:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789480236.744862:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527989760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.744899:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527989760:12345-0@lo:400:kworker.0 Request processed in 36us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.744903:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789480236.744914:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789480236.744920:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527989632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.744956:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527989632:12345-0@lo:400:kworker.0 Request processed in 37us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.744962:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789480236.744978:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480236.744981:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480236.745008:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527988608:0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.745024:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527989632:0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.745034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527988736:0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.745045:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527989248:0@lo:400:kworker.0 00010000:00080000:2.0:1789480236.745058:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812aaa00 x1876405527989760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480236.745069:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527989760:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745602:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527988992:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745662:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.745699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527989504:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745723:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.745748:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789480236.745756:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527988864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745777:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.745795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527989376:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480236.745839:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989504 00000100:00100000:0.0:1789480236.745845:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989504 00000100:00100000:0.0:1789480236.745879:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988864 00000100:00100000:0.0:1789480236.745882:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988864 00000100:00100000:0.0:1789480236.745908:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989376 00000100:00100000:0.0:1789480236.745911:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989376 00000100:00100000:0.0:1789480236.745927:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480236.745933:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527989504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.745972:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405527989504:12345-0@lo:400:kworker.0 Request processed in 40us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.745979:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789480236.745994:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789480236.746000:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527988864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.746025:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527988864:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.746030:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789480236.746040:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789480236.746057:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527989376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.746084:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1876405527989376:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480236.746090:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789480236.746106:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480236.746108:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789480236.746130:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527988864:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.746140:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1876405527989376:0@lo:400:kworker.0 00010000:00080000:0.0:1789480236.746150:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a812a8700 x1876405527989504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480236.746348:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989120 00000100:00100000:3.0:1789480236.746354:0:19538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989120 00000100:00100000:3.0:1789480236.746396:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789480236.746417:0:19538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527989120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789480236.746472:0:19538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527989120:12345-0@lo:400:kworker.0 Request processed in 59us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.746479:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789480236.746505:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789480236.746528:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527989120:0@lo:400:kworker.0 00000100:00100000:0.0:1789480236.746780:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405527989504:0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.746932:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527988992 00000100:00100000:2.0:1789480236.746937:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527988992 00000100:00100000:2.0:1789480236.746982:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789480236.746990:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527988992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480236.747046:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527988992:12345-0@lo:400:kworker.0 Request processed in 57us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.747052:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789480236.747451:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527988992:0@lo:400:kworker.0 00000100:00100000:1.0:1789480236.773994:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.774336:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507971968 00000100:00100000:2.0:1789480236.774348:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507971968 00000100:00100000:2.0:1789480236.774429:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:2.0:1789480236.774449:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+10:15036:x1876405507971968:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480236.774718:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480236.774764:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243e87d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f07 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.774800:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243e87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f07 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.774812:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047aa00/0xdaa289fda243e87d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f07 expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.774822:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047aa00, rc 0) 00000100:00100000:2.0:1789480236.779031:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507971968:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 4574us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.779047:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:1.0:1789480236.792673:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480236.794667:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972096 00000100:00100000:3.0:1789480236.794684:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972096 00000100:00100000:3.0:1789480236.794777:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:3.0:1789480236.794790:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507972096:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789480236.795017:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507972096:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 230us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.795025:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:1.0:1789480236.799923:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.800791:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972224 00000100:00100000:2.0:1789480236.800804:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972224 00000100:00100000:2.0:1789480236.800935:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:2.0:1789480236.800958:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507972224:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789480236.801140:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507972224:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 195us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.801149:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:0.0:1789480236.823945:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.827309:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972352 00000100:00100000:2.0:1789480236.827329:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972352 00000100:00100000:2.0:1789480236.827430:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:2.0:1789480236.827443:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972352:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480236.828384:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972352:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 938us (4445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.828396:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:1.0:1789480236.880774:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.882389:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972480 00000100:00100000:2.0:1789480236.882417:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972480 00000100:00100000:2.0:1789480236.882516:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:2.0:1789480236.882528:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972480:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480236.882904:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972480:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 377us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.882912:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:1.0:1789480236.887720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.888552:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972608 00000100:00100000:2.0:1789480236.888566:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972608 00000100:00100000:2.0:1789480236.888649:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:2.0:1789480236.888660:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972608:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480236.888851:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15044:x1876405507972608:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 193us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.888860:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:0.0:1789480236.891346:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.892769:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972736 00000100:00100000:2.0:1789480236.892785:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972736 00000100:00100000:2.0:1789480236.892990:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:2.0:1789480236.893002:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+11:15036:x1876405507972736:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480236.893022:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480236.893045:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243e884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f38 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.893078:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f38 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.893090:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a400/0xdaa289fda243e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f38 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.893121:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a400, rc 0) 00000100:00100000:2.0:1789480236.893246:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+12:15036:x1876405507972736:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 246us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.893254:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:1.0:1789480236.897775:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.897997:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972864 00000100:00100000:2.0:1789480236.898009:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972864 00000100:00100000:2.0:1789480236.898073:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:2.0:1789480236.898084:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+12:15036:x1876405507972864:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789480236.898116:0:17146:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789480236.898148:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789480236.898152:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789480236.898156:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789480236.898159:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789480236.899437:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1789480236.911923:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+12:15036:x1876405507972864:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 13824us (14147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.911942:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:0.0:1789480236.916716:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.916881:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507972992 00000100:00100000:2.0:1789480236.916902:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507972992 00000100:00100000:2.0:1789480236.916969:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:2.0:1789480236.916981:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+12:15036:x1876405507972992:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789480236.917000:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480236.917022:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f3f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.917053:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.917085:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480236.917096:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047a600, rc 0) 00000100:00100000:2.0:1789480236.917181:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15036:x1876405507972992:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 202us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.917223:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:1.0:1789480236.919875:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.920059:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973120 00000100:00100000:2.0:1789480236.920071:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973120 00000100:00100000:2.0:1789480236.920157:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:2.0:1789480236.920170:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15036:x1876405507973120:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789480236.921092:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15036:x1876405507973120:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 912us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.921103:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:1.0:1789480236.928110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480236.933094:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973248 00000100:00100000:3.0:1789480236.933114:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973248 00000100:00100000:3.0:1789480236.933440:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:3.0:1789480236.933453:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15036:x1876405507973248:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789480236.933639:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15036:x1876405507973248:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 190us (5542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.933647:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:0.0:1789480236.940120:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.940270:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973376 00000100:00100000:2.0:1789480236.940281:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973376 00000100:00100000:2.0:1789480236.940351:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:2.0:1789480236.940362:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15051:x1876405507973376:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789480236.944019:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15051:x1876405507973376:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 3641us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480236.944038:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:0.0:1789480236.950574:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480236.950678:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973504 00000100:00100000:3.0:1789480236.950689:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973504 00000100:00100000:3.0:1789480236.950758:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:3.0:1789480236.950770:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15051:x1876405507973504:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789480236.951162:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:15051:x1876405507973504:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 394us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.951631:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:1.0:1789480236.970427:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480236.970485:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480236.970701:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973632 00000100:00100000:3.0:1789480236.970712:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973632 00000100:00100000:3.0:1789480236.970766:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973888 00000100:00100000:3.0:1789480236.970770:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973888 00000100:00100000:3.0:1789480236.970809:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1789480236.970822:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876405507973632:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789480236.970854:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 8eab9df4-7373-4ca4-b729-98f6df36cc2b@192.168.206.44@tcp t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:3.0:1789480236.970911:0:17154:0:(genops.c:1384:class_connect()) connect: client 8eab9df4-7373-4ca4-b729-98f6df36cc2b, cookie 0xdaa289fda243e892 00000004:00100000:3.0:1789480236.970941:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789480236.971053:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6a8be4a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480236.971132:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2398:x1876405507973632:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 314us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.971151:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1789480236.971170:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1789480236.971175:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876405507973888:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789480236.971427:0:17154:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 8eab9df4-7373-4ca4-b729-98f6df36cc2b@192.168.206.44@tcp t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:3.0:1789480236.971455:0:17154:0:(genops.c:1384:class_connect()) connect: client 8eab9df4-7373-4ca4-b729-98f6df36cc2b, cookie 0xdaa289fda243e899 00000004:00100000:3.0:1789480236.971469:0:17154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789480236.971517:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a6a866c9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789480236.971544:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2398:x1876405507973888:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 367us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480236.971551:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1789480236.995150:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.995309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480236.998698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480237.003364:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974144 00000100:00100000:3.0:1789480237.003384:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974144 00000100:00100000:3.0:1789480237.003521:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974016 00000100:00100000:3.0:1789480237.003525:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974016 00000100:00100000:3.0:1789480237.003560:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1789480237.003571:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974144:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789480237.003609:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789480237.003705:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974144:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 136us (8569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480237.003713:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:3.0:1789480237.003735:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1789480237.003742:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:0:x1876405507974016:12345-192.168.206.44@tcp:41:mount.lustre.0 00000100:00080000:1.0:1789480237.004063:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789480237.004068:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789480237.005071:0:17154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789480237.005152:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:0:x1876405507974016:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 1405us (9837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480237.005186:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1789480237.006051:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507973760 00000100:00100000:2.0:1789480237.006063:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507973760 00000100:00100000:2.0:1789480237.006108:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1789480237.006118:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:0:x1876405507973760:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789480237.006143:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789480237.007612:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480237.007647:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974272 00000100:00100000:3.0:1789480237.007656:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974272 00000100:00100000:3.0:1789480237.007701:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:3.0:1789480237.007712:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+7:15036:x1876405507974272:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789480237.007773:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+7:15036:x1876405507974272:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480237.007781:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1789480237.008029:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:0:x1876405507973760:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 1910us (9340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480237.008038:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1789480237.018008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480237.018169:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974400 00000100:00100000:1.0:1789480237.018180:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974400 00000100:00100000:1.0:1789480237.018481:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1789480237.018491:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1876405507974400:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789480237.018530:0:18657:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 8eab9df4-7373-4ca4-b729-98f6df36cc2b@192.168.206.44@tcp t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:1.0:1789480237.018591:0:18657:0:(genops.c:1384:class_connect()) connect: client 8eab9df4-7373-4ca4-b729-98f6df36cc2b, cookie 0xdaa289fda243e8a0 00002000:00100000:1.0:1789480237.018604:0:18657:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8eab9df4-7373-4ca4-b729-98f6df36cc2b/ffff8a6986877800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789480237.018618:0:18657:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789480237.018731:0:18657:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789480237.018768:0:18657:0:(import.c:65:import_set_state_nolock()) ffff8a6986877000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789480237.019998:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2398:x1876405507974400:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 1500us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480237.020012:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:3.0:1789480237.027309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480237.027637:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974528 00000100:00100000:2.0:1789480237.027649:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974528 00000100:00100000:2.0:1789480237.027711:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1789480237.027720:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1876405507974528:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789480237.027763:0:18658:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 8eab9df4-7373-4ca4-b729-98f6df36cc2b@192.168.206.44@tcp t0 exp 0000000000000000 cur 605 last 0 00000020:00000080:2.0:1789480237.027801:0:18658:0:(genops.c:1384:class_connect()) connect: client 8eab9df4-7373-4ca4-b729-98f6df36cc2b, cookie 0xdaa289fda243e8a7 00002000:00100000:2.0:1789480237.027815:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8eab9df4-7373-4ca4-b729-98f6df36cc2b/ffff8a6aaa4a8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789480237.027829:0:18658:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789480237.028052:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480237.028689:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974656 00000100:00100000:3.0:1789480237.028700:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974656 00000100:00100000:3.0:1789480237.028763:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1789480237.028771:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974656:12345-192.168.206.44@tcp:900:mount.lustre.0 00002000:00080000:2.0:1789480237.028856:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789480237.028996:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974656:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 225us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480237.029005:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00080000:2.0:1789480237.029569:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8a6aaa4a9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789480237.029614:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2398:x1876405507974528:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 1893us (2318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480237.029624:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1789480237.032283:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480237.032392:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974784 00000100:00100000:3.0:1789480237.032414:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974784 00000100:00100000:3.0:1789480237.032477:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:3.0:1789480237.032639:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974784:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789480237.032760:0:17156:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789480237.034186:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15036:x1876405507974784:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 1541us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480237.034237:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00010000:00010000:3.0:1789480237.252922:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480237.284932:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480237.285099:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507974912 00000100:00100000:3.0:1789480237.285112:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507974912 00000100:00100000:3.0:1789480237.285241:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1789480237.285253:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15074:x1876405507974912:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:3.0:1789480237.285275:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480237.285300:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e8ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f70 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285374:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285388:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285414:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480237.285466:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789480237.285470:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480237.285496:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285526:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecda00/0xdaa289fda243e8ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285545:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480237.285553:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:3.0:1789480237.285556:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480237.285560:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd200, rc 0) 00000100:00100000:3.0:1789480237.285630:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+7:15074:x1876405507974912:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 379us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480237.285643:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1789480237.764700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527989888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789480237.764799:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480237.765082:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527989888 00000100:00100000:2.0:1789480237.765091:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527989888 00000100:00100000:2.0:1789480237.765166:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789480237.765224:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527989888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789480237.765251:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789480237.765322:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527989888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480237.765329:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480237.765951:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527989888:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789480238.276367:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480238.788451:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527990016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480238.788519:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480238.788661:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480238.788670:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527990144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480238.788698:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480238.788725:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990016 00000100:00100000:1.0:1789480238.788734:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990016 00000100:00100000:1.0:1789480238.788775:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990144 00000100:00100000:1.0:1789480238.788778:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990144 00000100:00100000:1.0:1789480238.788793:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789480238.788800:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527990016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789480238.788837:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789480238.788883:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527990016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480238.788903:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789480238.788920:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789480238.788927:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527990144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480238.788943:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789480238.788974:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527990144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480238.788980:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789480238.789099:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527990144:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789480238.789133:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527990016:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789480239.302608:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789480239.821742:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8eab9df4-7373-4ca4-b729-98f6df36cc2b 00000001:00100000:2.0:1789480239.821754:0:19472:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4e1b46fe-7168-46d1-8c19-6654dff86af2 00000001:00100000:0.0:1789480239.825173:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8eab9df4-7373-4ca4-b729-98f6df36cc2b 00000001:00100000:0.0:1789480239.825219:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4e1b46fe-7168-46d1-8c19-6654dff86af2 00000001:00100000:1.0:1789480239.825685:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8eab9df4-7373-4ca4-b729-98f6df36cc2b 00000001:00100000:1.0:1789480239.825695:0:18653:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4e1b46fe-7168-46d1-8c19-6654dff86af2 00000001:00100000:1.0:1789480239.826364:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8eab9df4-7373-4ca4-b729-98f6df36cc2b 00000001:00100000:1.0:1789480239.826370:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4e1b46fe-7168-46d1-8c19-6654dff86af2 00000001:02000400:2.0:1789480239.972586:0:20028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789480240.326015:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789480241.348437:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480241.860733:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527990272:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.860794:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.860834:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527990784:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.860873:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.860894:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527991296:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.860913:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.860930:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527991808:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.860950:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.860973:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789480241.860978:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527990656:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861000:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527991168:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861034:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861061:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527991680:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861080:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527990400:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861147:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527990912:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861164:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861180:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527991424:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527991936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480241.861250:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861267:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789480241.861272:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527990528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861309:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527991040:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861326:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861495:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527991552:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861518:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480241.861547:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990272 00000100:00100000:2.0:1789480241.861553:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990272 00000100:00100000:2.0:1789480241.861594:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789480241.861601:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527990272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.861649:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527990272:12345-0@lo:400:kworker.0 Request processed in 47us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.861657:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789480241.866476:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990784 00000100:00100000:2.0:1789480241.866498:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990784 00000100:00100000:2.0:1789480241.866550:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991296 00000100:00100000:2.0:1789480241.866554:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991296 00000100:00100000:2.0:1789480241.866568:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991808 00000100:00100000:2.0:1789480241.866570:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991808 00000100:00100000:2.0:1789480241.866604:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991680 00000100:00100000:2.0:1789480241.866607:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991680 00000100:00100000:2.0:1789480241.866619:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991424 00000100:00100000:2.0:1789480241.866621:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991424 00000100:00100000:2.0:1789480241.866634:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991552 00000100:00100000:2.0:1789480241.866637:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991552 00000100:00100000:2.0:1789480241.866654:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789480241.866662:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527990784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.866745:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876405527990784:12345-0@lo:400:kworker.0 Request processed in 83us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.866751:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789480241.866768:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789480241.866773:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527991296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.866801:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405527991296:12345-0@lo:400:kworker.0 Request processed in 28us (5887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.866806:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789480241.866816:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789480241.868980:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527991808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869059:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405527991808:12345-0@lo:400:kworker.0 Request processed in 93us (8107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869067:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789480241.869096:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789480241.869104:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527991680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869141:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405527991680:12345-0@lo:400:kworker.0 Request processed in 40us (8060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869147:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789480241.869159:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480241.869165:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527991424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869226:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405527991424:12345-0@lo:400:kworker.0 Request processed in 60us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869232:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789480241.869245:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789480241.869251:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527991552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869294:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876405527991552:12345-0@lo:400:kworker.0 Request processed in 42us (7774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869299:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789480241.869333:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990656 00000100:00100000:2.0:1789480241.869350:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990656 00000100:00100000:2.0:1789480241.869397:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991168 00000100:00100000:2.0:1789480241.869401:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991168 00000100:00100000:2.0:1789480241.869414:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990528 00000100:00100000:2.0:1789480241.869417:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990528 00000100:00100000:2.0:1789480241.869428:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991040 00000100:00100000:2.0:1789480241.869431:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991040 00000100:00100000:2.0:1789480241.869442:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480241.869447:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527990656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869480:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527990656:12345-0@lo:400:kworker.0 Request processed in 32us (8479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869485:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789480241.869496:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480241.869509:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527991168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869536:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527991168:12345-0@lo:400:kworker.0 Request processed in 28us (8501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869542:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789480241.869554:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480241.869559:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527990528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869586:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527990528:12345-0@lo:400:kworker.0 Request processed in 27us (8292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869592:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789480241.869602:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480241.869608:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527991040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869634:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527991040:12345-0@lo:400:kworker.0 Request processed in 27us (8307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869640:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789480241.869667:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990400 00000100:00100000:2.0:1789480241.869671:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990400 00000100:00100000:2.0:1789480241.869701:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527990912 00000100:00100000:2.0:1789480241.869704:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527990912 00000100:00100000:2.0:1789480241.869716:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789480241.869722:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527990400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869752:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527990400:12345-0@lo:400:kworker.0 Request processed in 30us (8621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869758:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789480241.869769:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789480241.869774:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527990912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.869799:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527990912:12345-0@lo:400:kworker.0 Request processed in 25us (8633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869811:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789480241.869833:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527991936 00000100:00100000:2.0:1789480241.869838:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527991936 00000100:00100000:2.0:1789480241.869878:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789480241.869885:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527991936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789480241.869906:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789480241.869937:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527991936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (8686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480241.869943:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789480241.869970:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480241.869973:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480241.869976:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789480241.869978:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789480241.870021:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527990528:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870034:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527991040:0@lo:400:kworker.0 00010000:00080000:2.0:1789480241.870048:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f4e00 x1876405527991552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480241.870058:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1876405527991552:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870067:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527990400:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870076:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527990912:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405527991424:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527991936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480241.870153:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527990656:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870171:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527991168:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870182:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405527991680:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870216:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527990272:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870228:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a812a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876405527990784:0@lo:400:kworker.0 00000100:00100000:2.0:1789480241.870239:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6986a1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405527991296:0@lo:400:kworker.0 00010000:00080000:2.0:1789480241.870250:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866f5500 x1876405527991808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789480241.870259:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405527991808:0@lo:400:kworker.0 00000100:00100000:0.0:1789480241.871617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527992064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480241.871676:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480241.871720:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992064 00000100:00100000:0.0:1789480241.871726:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992064 00000100:00100000:0.0:1789480241.871758:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789480241.871765:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527992064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789480241.871792:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480241.871833:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527992064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480241.871853:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789480241.871954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb56fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527992064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480241.873307:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789480241.873324:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527992192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480241.873403:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480241.873444:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992192 00000100:00100000:1.0:1789480241.873452:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992192 00000100:00100000:1.0:1789480241.873488:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789480241.873496:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527992192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789480241.873513:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789480241.873548:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527992192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480241.873555:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789480241.873597:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527992192:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789480242.372463:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480242.519996:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520038:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520062:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520076:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520095:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520112:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520126:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520139:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520158:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480242.520180:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975040 00000100:00100000:0.0:1789480242.520211:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975040 00000100:00100000:3.0:1789480242.520217:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975424 00000100:00100000:3.0:1789480242.520221:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975424 00000100:00100000:0.0:1789480242.520255:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1789480242.520264:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975936 00000100:00100000:3.0:1789480242.520267:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975936 00000100:00100000:0.0:1789480242.520274:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2400:x1876405507975040:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480242.520279:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975552 00000100:00100000:3.0:1789480242.520291:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975552 00000100:00100000:3.0:1789480242.520305:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976064 00000100:00100000:3.0:1789480242.520307:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976064 00000100:00100000:3.0:1789480242.520318:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:3.0:1789480242.520324:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975424:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480242.520333:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2400:x1876405507975040:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480242.520339:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1789480242.520348:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975424:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480242.520354:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:3.0:1789480242.520365:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1789480242.520370:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507975936:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480242.520403:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507975936:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480242.520409:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1789480242.520421:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1789480242.520427:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975552:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480242.520446:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975552:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 20us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480242.520461:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1789480242.520474:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:3.0:1789480242.520480:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507976064:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480242.520518:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507976064:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480242.520524:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:1.0:1789480242.520536:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975168 00000100:00080000:3.0:1789480242.520539:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480242.520540:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975168 00000100:00080000:3.0:1789480242.520542:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789480242.520570:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975680 00000100:00080000:3.0:1789480242.520572:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480242.520573:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975680 00000100:00080000:3.0:1789480242.520589:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480242.520589:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975296 00000100:00100000:1.0:1789480242.520591:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975296 00000100:00080000:3.0:1789480242.520603:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480242.520605:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507975808 00000100:00100000:1.0:1789480242.520608:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507975808 00000100:00080000:3.0:1789480242.520627:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789480242.520628:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:1.0:1789480242.520634:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2400:x1876405507975168:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480242.520664:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2400:x1876405507975168:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480242.520670:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:1.0:1789480242.520683:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480242.520690:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2400:x1876405507975680:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480242.520715:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2400:x1876405507975680:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480242.520720:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1789480242.520732:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1789480242.520738:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975296:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480242.520761:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2400:x1876405507975296:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480242.520766:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1789480242.520778:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:1.0:1789480242.520784:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507975808:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480242.520815:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2400:x1876405507975808:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480242.520822:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000040:00080000:3.0:1789480242.695484:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789480242.885348:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527992320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480242.885425:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480242.885506:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992320 00000100:00100000:0.0:1789480242.885514:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992320 00000100:00100000:0.0:1789480242.885572:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789480242.885581:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527992320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480242.885599:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480242.885643:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527992320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480242.885649:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789480242.885686:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527992320:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789480243.397728:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480243.908487:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480243.908982:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527992576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789480243.909047:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480243.909087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527992448:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789480243.909110:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480243.909907:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992576 00000100:00100000:2.0:1789480243.909916:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992576 00000100:00100000:2.0:1789480243.909967:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992448 00000100:00100000:2.0:1789480243.909971:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992448 00000100:00100000:2.0:1789480243.909987:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789480243.909994:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527992576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789480243.910025:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789480243.910081:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405527992576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480243.910088:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789480243.910103:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789480243.910110:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527992448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789480243.910127:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789480243.910238:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527992448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480243.910258:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789480243.910300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405527992576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480243.910311:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527992448:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789480244.153425:0:20175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeabb3e70 20000000:00000080:0.0:1789480244.153444:0:20175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a6a983e4400 uarg=0000000000000000 20000000:01000000:0.0:1789480244.153485:0:20175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789480244.153491:0:20175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789480244.153495:0:20175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789480244.154565:0:20176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789480244.154724:0:20175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789480244.165337:0:20175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789480244.165718:0:20175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165738:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e54a expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165746:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e558 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165774:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e597 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165780:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165788:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165795:0:20175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165803:0:20175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165848:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.165874:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.165888:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992704:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480244.166035:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.166043:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 12 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.166051:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992832:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480244.166093:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.166101:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.166109:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992960:0@lo:104: 00000100:00100000:3.0:1789480244.166156:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480244.166394:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.166403:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 23 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.166412:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993088:0@lo:104: 00000100:00100000:3.0:1789480244.166434:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789480244.174083:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.174098:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 23 pid: 17145 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.174111:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993216:0@lo:104: 00000100:00100000:3.0:1789480244.174449:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480244.174485:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527992960 00000100:00100000:1.0:1789480244.174493:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527992960 00000100:00100000:1.0:1789480244.174532:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993088 00000100:00100000:1.0:1789480244.174536:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993088 00000100:00100000:1.0:1789480244.174551:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480244.174560:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:20175:x1876405527992960:12345-0@lo:104: 00010000:00010000:1.0:1789480244.174572:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174620:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480244.174626:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:20175:x1876405527992960:12345-0@lo:104: Request processed in 68us (8471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.174634:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480244.174650:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480244.174656:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:20175:x1876405527993088:12345-0@lo:104: 00010000:00010000:1.0:1789480244.174663:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174697:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789480244.174703:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:20175:x1876405527993088:12345-0@lo:104: Request processed in 48us (8268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.174709:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789480244.174740:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480244.174746:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174754:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecd400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480244.174758:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174766:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480244.174773:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480244.174780:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480244.174808:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174815:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480244.174834:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174841:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6987ecd400/0xdaa289fda243e631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e638 expref: -99 pid: 19471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174853:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480244.174856:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174862:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc400 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480244.174865:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174877:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480244.174883:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480244.174888:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480244.174901:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174906:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480244.174912:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174919:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6987ecc400/0xdaa289fda243e597 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e59e expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.174927:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480244.174928:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480244.174930:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480244.174936:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480244.174951:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527993344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.174978:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480244.175046:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789480244.175053:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527993472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.175075:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480244.175103:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993344 00000100:00100000:1.0:1789480244.175106:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993344 00010000:00010000:1.0:1789480244.175148:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 24 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.175170:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993472 00000100:00100000:1.0:1789480244.175174:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993472 00010000:00010000:1.0:1789480244.175186:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 25 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.175226:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480244.175234:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+25:3645:x1876405527993344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.175245:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.175250:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 25 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.175260:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 25 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.175276:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.175305:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+25:3645:x1876405527993344:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.175311:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789480244.175324:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480244.175332:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3645:x1876405527993472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.175340:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.175343:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 24 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.175352:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 24 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.175383:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.175406:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3645:x1876405527993472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.175411:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789480244.175449:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527993472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.175457:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3645:1876405527993344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789480244.176479:0:20175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.176495:0:20175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 23 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.176523:0:20175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993600:0@lo:104: 00000100:00100000:3.0:1789480244.176560:0:20175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480244.176574:0:20175:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa4ba180 going to sleep for 11 seconds 00010000:00010000:3.0:1789480244.176590:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5da400/0xdaa289fda243e638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e631 expref: 23 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.176605:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817ba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992960:0@lo:104: 00010000:00010000:3.0:1789480244.176615:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb4bdc00/0xdaa289fda243e59e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e597 expref: 22 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.176623:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993088:0@lo:104: 00000100:00100000:1.0:1789480244.176675:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993216 00000100:00100000:1.0:1789480244.176681:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993216 00000100:00100000:1.0:1789480244.176707:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993600 00000100:00100000:1.0:1789480244.176710:0:17136:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993600 00000100:00100000:1.0:1789480244.176722:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480244.176729:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:20175:x1876405527993216:12345-0@lo:104: 00010000:00010000:1.0:1789480244.176740:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.176800:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789480244.176806:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+4:20175:x1876405527993216:12345-0@lo:104: Request processed in 77us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.176813:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480244.176828:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480244.176834:0:17136:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:20175:x1876405527993600:12345-0@lo:104: 00010000:00010000:1.0:1789480244.176841:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.176889:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789480244.176894:0:17136:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+3:20175:x1876405527993600:12345-0@lo:104: Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.176906:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789480244.176920:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789480244.176925:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.176932:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecca00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480244.176936:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.176945:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480244.176952:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480244.176957:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480244.176980:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.176986:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480244.177003:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177010:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6987ecca00/0xdaa289fda243e558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e55f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177019:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789480244.177022:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177037:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987eccc00 already unused, calling callback (ffffffffc136bc20) 10000000:00010000:1.0:1789480244.177039:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177045:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789480244.177051:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480244.177056:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789480244.177068:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177074:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789480244.177079:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177086:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8a6987eccc00/0xdaa289fda243e54a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdaa289fda243e551 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177098:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480244.177100:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789480244.177101:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480244.177117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527993728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.177156:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480244.177176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789480244.177181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527993856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.177237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480244.177264:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993728 00000100:00100000:1.0:1789480244.177269:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993728 00010000:00010000:1.0:1789480244.177288:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 22 pid: 17145 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.177306:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993856 00000100:00100000:1.0:1789480244.177309:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993856 00010000:00010000:1.0:1789480244.177319:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 23 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.177330:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480244.177337:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:3647:x1876405527993728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.177345:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.177350:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 23 pid: 17145 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177358:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 23 pid: 17145 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177386:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.177413:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:3647:x1876405527993728:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.177419:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789480244.177432:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480244.177438:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:3647:x1876405527993856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.177445:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.177449:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 22 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177466:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 22 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.177474:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.177496:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:3647:x1876405527993856:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.177501:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789480244.177534:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527993856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789480244.177541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3647:1876405527993728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789480244.177612:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789480244.178050:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb3c1e00/0xdaa289fda243e55f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e558 expref: 21 pid: 17145 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.178063:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993216:0@lo:104: 00010000:00010000:3.0:1789480244.178073:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdaa289fda243e54a expref: 20 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480244.178081:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527993600:0@lo:104: 00000100:00100000:3.0:1789480244.181993:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988821180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992704:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480244.188470:0:20175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817b8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20175:1876405527992832:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480244.188513:0:20175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480244.193347:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480244.193630:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480244.193871:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976320 00000100:00100000:1.0:1789480244.193880:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976320 00010000:00010000:1.0:1789480244.193916:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 13 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.193947:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976192 00000100:00100000:1.0:1789480244.193950:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976192 00010000:00010000:1.0:1789480244.193962:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 14 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480244.193976:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:1.0:1789480244.193983:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986b27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea11d651-dcbe-4d90-aa74-3e752427f416+14:2401:x1876405507976320:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.194019:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.194026:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 14 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194036:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 14 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194064:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047ba00/0xdaa289fda243e84c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ecf expref: 14 pid: 17146 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194081:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.194145:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986b27050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2401:x1876405507976320:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 161us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.194153:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:1.0:1789480244.194230:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:1.0:1789480244.194238:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea11d651-dcbe-4d90-aa74-3e752427f416+12:2402:x1876405507976192:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480244.194246:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480244.194251:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194261:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194271:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6ac047a600/0xdaa289fda243e88b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f3f expref: 12 pid: 17147 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194283:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194291:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194307:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194324:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194331:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194337:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194342:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecda00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:1.0:1789480244.194347:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194354:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194378:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480244.194388:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480244.194409:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:2402:x1876405507976192:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 173us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480244.194416:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00010000:00010000:3.0:1789480244.196566:0:20175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.196599:0:20175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.196606:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e8bc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480244.429379:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789480244.996931:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789480245.255851:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480245.255858:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6aab16f000 from 13 10000000:01000000:0.0:1789480245.255863:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480245.255905:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.255931:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.255943:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480245.255966:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527993984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.256039:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.256080:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332840 going to sleep for 11 seconds 00000100:00100000:1.0:1789480245.256129:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527993984 00000100:00100000:1.0:1789480245.256137:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527993984 00000100:00100000:1.0:1789480245.256184:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789480245.256269:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+20:17149:x1876405527993984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480245.256281:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480245.256305:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a80031800/0xdaa289fda243e8ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e8c3 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.256334:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a80031800/0xdaa289fda243e8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e8c3 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.256344:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a80031800/0xdaa289fda243e8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e8c3 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.256353:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80031800, rc 0) 00000100:00100000:1.0:1789480245.256405:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527993984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.256411:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789480245.256603:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527993984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480245.256618:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8ca expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480245.256626:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e8ca expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480245.256682:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480245.256708:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480245.256745:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa4baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.256860:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994112 00000100:00100000:0.0:1789480245.256865:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994112 00000100:00100000:0.0:1789480245.256901:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789480245.256909:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527994112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.257009:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527994112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.257016:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789480245.257045:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.257073:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.257109:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.257134:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.257145:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994240 00000100:00100000:0.0:1789480245.257148:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994240 00000100:00100000:0.0:1789480245.257163:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789480245.257169:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527994240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.257252:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527994240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.257263:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789480245.257313:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789480245.257961:0:20215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789480245.258015:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789480245.258037:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789480245.258045:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8ca expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258054:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da400/0xdaa289fda243e8c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8ca expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789480245.258064:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789480245.258066:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6aab30a800 from 13 10000000:01000000:0.0:1789480245.258069:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789480245.258090:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258098:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258107:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480245.258121:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258151:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.258168:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.258181:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994368 00000100:00100000:0.0:1789480245.258185:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994368 00000100:00100000:0.0:1789480245.258233:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789480245.258239:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+21:17149:x1876405527994368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480245.258249:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480245.258260:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e8d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e8d1 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258279:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e8d1 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258289:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6abb5da600/0xdaa289fda243e8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e8d1 expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258297:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da600, rc 0) 00000100:00100000:0.0:1789480245.258327:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.258333:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789480245.258374:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480245.258386:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8d8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.258395:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e8d8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480245.258433:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258457:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.258469:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.258480:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994496 00000100:00100000:0.0:1789480245.258483:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994496 00000100:00100000:0.0:1789480245.258506:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480245.258511:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258585:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.258591:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789480245.258618:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258646:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258677:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.258690:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab33329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.258701:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994624 00000100:00100000:0.0:1789480245.258705:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994624 00000100:00100000:0.0:1789480245.258721:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789480245.258726:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.258786:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.258793:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789480245.262288:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789480245.262974:0:20216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789480245.263055:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789480245.263077:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789480245.263086:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8d8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.263097:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6abb5da200/0xdaa289fda243e8d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8d8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789480245.263107:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789480245.263109:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a698885a800 from 13 10000000:01000000:1.0:1789480245.263112:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789480245.263153:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.263161:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.263183:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480245.263233:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789480245.263286:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480245.263317:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a95caf840 going to sleep for 11 seconds 00000100:00100000:0.0:1789480245.263978:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994752 00000100:00100000:0.0:1789480245.264415:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994752 00000100:00100000:1.0:1789480245.264640:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789480245.264651:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+22:17149:x1876405527994752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480245.264664:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480245.264678:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a80030400/0xdaa289fda243e8e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e8df expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.264700:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a80030400/0xdaa289fda243e8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e8df expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.264711:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a80030400/0xdaa289fda243e8e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e8df expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.264718:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030400, rc 0) 00000100:00100000:1.0:1789480245.272457:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527994752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7800us (9162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.272470:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789480245.274587:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789480245.274618:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8e6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480245.274631:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e8e6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480245.274712:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.274818:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.274855:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480245.275063:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527994880 00000100:00100000:3.0:1789480245.275071:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527994880 00000100:00100000:3.0:1789480245.275114:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789480245.275124:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527994880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789480245.275254:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527994880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.275261:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789480245.276090:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527994880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.276158:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.276226:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480245.276252:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab3332180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480245.279076:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995008 00000100:00100000:3.0:1789480245.279097:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995008 00000100:00100000:3.0:1789480245.279155:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789480245.279164:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527995008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480245.279323:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527995008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.279330:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789480245.279391:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789480245.280418:0:20219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789480245.280686:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789480245.280714:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480245.280724:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8e6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.280737:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6a80031000/0xdaa289fda243e8df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8e6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789480245.280746:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789480245.280749:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a6988485000 from 13 10000000:01000000:2.0:1789480245.280752:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789480245.280783:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.280791:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.280801:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480245.280822:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.280869:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480245.280902:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480245.280922:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995136 00000100:00100000:2.0:1789480245.280928:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995136 00000100:00100000:2.0:1789480245.280961:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789480245.280969:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+23:17149:x1876405527995136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480245.280980:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480245.280991:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6ac047ae00/0xdaa289fda243e8f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdaa289fda243e8ed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.281022:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6ac047ae00/0xdaa289fda243e8f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdaa289fda243e8ed expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.281034:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6ac047ae00/0xdaa289fda243e8f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdaa289fda243e8ed expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.281042:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047ae00, rc 0) 00000100:00100000:2.0:1789480245.281087:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527995136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480245.281094:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789480245.281399:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789480245.281412:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8f4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.281421:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdaa289fda243e8f4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480245.281470:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.281504:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480245.281523:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480245.281884:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995264 00000100:00100000:2.0:1789480245.281889:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995264 00000100:00100000:2.0:1789480245.281921:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789480245.281928:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527995264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.282037:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527995264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480245.282044:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789480245.282072:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.282099:0:17149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.282147:0:17149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480245.282162:0:17149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789480245.282174:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995392 00000100:00100000:2.0:1789480245.282177:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995392 00000100:00100000:2.0:1789480245.282222:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480245.282228:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527995392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.282295:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:17149:x1876405527995392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480245.282302:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789480245.282340:0:17149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:51483ccc-9e15-472d-aee3-1dbbbf4be94f:17149:1876405527995392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789480245.282999:0:20222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789480245.283046:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789480245.283062:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789480245.283069:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8f4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480245.283079:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8a6ac047b600/0xdaa289fda243e8ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdaa289fda243e8f4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480245.400501:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480245.400541:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976448 00000100:00100000:1.0:1789480245.400551:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976448 00000100:00100000:1.0:1789480245.400601:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:1.0:1789480245.400612:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+11:14921:x1876405507976448:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789480245.400640:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480245.400661:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6a80031c00/0xdaa289fda243e8fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f77 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.400702:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6a80031c00/0xdaa289fda243e8fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f77 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.400713:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6a80031c00/0xdaa289fda243e8fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f77 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480245.400722:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80031c00, rc 0) 00000100:00100000:1.0:1789480245.400772:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976448:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 162us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.400779:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 159 00000100:00100000:3.0:1789480245.424879:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480245.424951:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976576 00000100:00100000:1.0:1789480245.424960:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976576 00000100:00100000:1.0:1789480245.425014:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:1.0:1789480245.425026:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976576:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789480245.425163:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976576:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 139us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480245.425170:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 160 00000100:00100000:1.0:1789480245.427505:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480245.427570:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976704 00000100:00100000:2.0:1789480245.427580:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976704 00000100:00100000:2.0:1789480245.427631:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 161 00000100:00100000:2.0:1789480245.427641:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976704:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789480245.427763:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976704:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 123us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480245.427771:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 161 00010000:00010000:1.0:1789480245.444581:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480245.452565:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480245.453313:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976832 00000100:00100000:3.0:1789480245.453334:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976832 00000100:00100000:3.0:1789480245.453780:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:3.0:1789480245.453792:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+12:14921:x1876405507976832:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789480245.453808:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480245.453825:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e902 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f7e expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480245.453851:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f7e expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480245.453862:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a6987ecda00/0xdaa289fda243e902 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f7e expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480245.453870:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecda00, rc 0) 00000100:00100000:3.0:1789480245.453920:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:14921:x1876405507976832:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 132us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.453927:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 162 00000100:00100000:3.0:1789480245.466629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480245.467387:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507976960 00000100:00100000:0.0:1789480245.467397:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507976960 00000100:00100000:0.0:1789480245.467452:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:0.0:1789480245.467462:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:14921:x1876405507976960:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789480245.467595:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6981c74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:14921:x1876405507976960:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 134us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480245.467602:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 163 00000100:00100000:2.0:1789480245.471489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480245.471929:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977088 00000100:00100000:3.0:1789480245.471939:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977088 00000100:00100000:3.0:1789480245.475087:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 164 00000100:00100000:3.0:1789480245.475105:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:14921:x1876405507977088:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789480245.475256:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:14921:x1876405507977088:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 156us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480245.475264:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 164 00010000:00010000:1.0:1789480246.470583:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480246.980371:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789480246.980393:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527995520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480246.980460:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480246.980504:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527995648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789480246.980526:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480246.980572:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995520 00000100:00100000:3.0:1789480246.980580:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995520 00000100:00100000:3.0:1789480246.980635:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995648 00000100:00100000:3.0:1789480246.980639:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995648 00000100:00100000:3.0:1789480246.980657:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789480246.980666:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527995520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789480246.980694:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789480246.980738:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527995520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480246.980746:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789480246.980761:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789480246.980768:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527995648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789480246.980783:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789480246.980810:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527995648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480246.980816:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789480246.980878:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480246.980883:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480246.980916:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527995520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789480246.980928:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527995648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480246.981996:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527995904:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.982087:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527996160:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.982123:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527996032:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.982157:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480246.982183:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527996544:0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.982187:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480246.982224:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.982230:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527996416:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.982237:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527997056:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.982292:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527995776:0@lo:400:kworker.0 00000100:00100000:2.0:1789480246.982367:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995904 00000100:00100000:2.0:1789480246.982374:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995904 00000100:00100000:2.0:1789480246.982416:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789480246.982424:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527995904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.988699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.988762:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527996928:0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.988815:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.988867:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996032 00000100:00100000:1.0:1789480246.988874:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996032 00000100:00100000:1.0:1789480246.988916:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996544 00000100:00100000:1.0:1789480246.988919:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996544 00000100:00100000:1.0:1789480246.988930:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996928 00000100:00100000:1.0:1789480246.988932:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996928 00000100:00100000:1.0:1789480246.988957:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480246.988965:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527996032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989013:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1876405527996032:12345-0@lo:400:kworker.0 Request processed in 49us (6855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989020:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789480246.989036:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789480246.989042:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527996544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989069:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1876405527996544:12345-0@lo:400:kworker.0 Request processed in 28us (6844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989075:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789480246.989087:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480246.989093:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527996928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989220:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876405527996928:12345-0@lo:400:kworker.0 Request processed in 126us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989226:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789480246.989247:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996416 00000100:00100000:1.0:1789480246.989251:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996416 00000100:00100000:0.0:1789480246.989282:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.989294:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789480246.989300:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527996416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.989322:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527996288:0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989327:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876405527996416:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989332:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789480246.989345:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789480246.989367:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789480246.989372:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789480246.989376:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527996800:0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989381:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480246.989396:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.989404:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527996672:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.989421:0:19103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996288 00000100:00100000:1.0:1789480246.989424:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480246.989424:0:19103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996288 00000100:00100000:1.0:1789480246.989439:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69817b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527997184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789480246.989452:0:19103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789480246.989458:0:19103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527996288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989461:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480246.989487:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996800 00000100:00100000:1.0:1789480246.989490:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996800 00000100:00100000:0.0:1789480246.989507:0:19103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527996288:12345-0@lo:400:kworker.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989509:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996672 00000100:00100000:1.0:1789480246.989511:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996672 00000100:00100000:0.0:1789480246.989513:0:19103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789480246.989524:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789480246.989529:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527996800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789480246.989529:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789480246.989531:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480246.989533:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789480246.989541:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789480246.989546:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527996672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.989558:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876405527996800:12345-0@lo:400:kworker.0 Request processed in 29us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480246.989564:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480246.989571:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876405527996672:12345-0@lo:400:kworker.0 Request processed in 26us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480246.989577:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789480246.989610:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527996288:0@lo:400:kworker.0 00010000:00080000:0.0:1789480246.989622:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6abb5dce00 x1876405527996800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789480246.989631:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1876405527996800:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.989673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1876405527996416:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.989689:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1876405527996928:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.989731:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1876405527996672:0@lo:400:kworker.0 00000100:00100000:1.0:1789480246.991468:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527995776 00000100:00100000:0.0:1789480246.991468:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527996160 00000100:00100000:1.0:1789480246.991479:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527995776 00000100:00100000:0.0:1789480246.991486:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527996160 00000100:00100000:0.0:1789480246.991515:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480246.991524:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527996160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.991604:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527996160:12345-0@lo:400:kworker.0 Request processed in 81us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480246.991612:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789480246.991651:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527996160:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.991671:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527997184 00000100:00100000:0.0:1789480246.991675:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527997184 00000100:00100000:0.0:1789480246.991705:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789480246.991712:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527997184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789480246.991728:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789480246.991749:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789480246.991757:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527995776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.991762:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527997184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480246.991768:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789480246.991794:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3646:x1876405527995776:12345-0@lo:400:kworker.0 Request processed in 39us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480246.991800:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69817b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527997184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480246.991812:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789480246.991821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3646:1876405527995776:0@lo:400:kworker.0 00000100:00100000:2.0:1789480246.991912:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527995904:12345-0@lo:400:kworker.0 Request processed in 9488us (9724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480246.991919:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789480246.991946:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527995904:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.993907:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480246.993987:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1876405527996032:0@lo:400:kworker.0 00000100:00100000:3.0:1789480246.994002:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1876405527996544:0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.994312:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527997056 00000100:00100000:0.0:1789480246.994320:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527997056 00000100:00100000:0.0:1789480246.994446:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789480246.994456:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527997056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480246.994537:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1876405527997056:12345-0@lo:400:kworker.0 Request processed in 83us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480246.994556:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789480246.994724:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69888d5500 x1876405527997056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789480246.994735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1876405527997056:0@lo:400:kworker.0 00000100:00080000:1.0:1789480246.995385:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789480247.492469:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789480247.648772:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.648873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.648911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.648940:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480247.649097:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977728 00000100:00100000:0.0:1789480247.649118:0:19538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977728 00000100:00100000:3.0:1789480247.650448:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977216 00000100:00100000:3.0:1789480247.650460:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977216 00000100:00100000:3.0:1789480247.650527:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:3.0:1789480247.650538:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2402:x1876405507977216:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480247.650604:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2402:x1876405507977216:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 68us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480247.650611:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:0.0:1789480247.651027:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1789480247.651036:0:19538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977728:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480247.651076:0:19538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977728:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 42us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.651083:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:1.0:1789480247.652430:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.652478:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.652500:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.652517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.652546:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.652576:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977472 00000100:00100000:1.0:1789480247.652584:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977472 00000100:00100000:1.0:1789480247.652622:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977984 00000100:00100000:1.0:1789480247.652626:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977984 00000100:00100000:1.0:1789480247.652641:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977344 00000100:00100000:1.0:1789480247.652643:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977344 00000100:00100000:1.0:1789480247.652655:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977856 00000100:00100000:1.0:1789480247.652657:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977856 00000100:00100000:1.0:1789480247.652672:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:1.0:1789480247.652681:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977472:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480247.653531:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977472:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 846us (4653us total) trans 0 rc 0/0 00000100:00080000:0.0:1789480247.653543:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480247.653544:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00080000:0.0:1789480247.653552:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789480247.653556:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789480247.653573:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:0.0:1789480247.653573:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978240 00000100:00100000:0.0:1789480247.653581:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978240 00000100:00100000:1.0:1789480247.653586:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507977984:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480247.653620:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507977600 00000100:00100000:0.0:1789480247.653625:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507977600 00000100:00100000:0.0:1789480247.653642:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978112 00000100:00100000:1.0:1789480247.653643:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507977984:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 61us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653646:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978112 00000100:00100000:1.0:1789480247.653655:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:1.0:1789480247.653674:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:0.0:1789480247.653681:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1789480247.653685:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2402:x1876405507977344:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480247.653697:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507978240:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480247.653719:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2402:x1876405507977344:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 37us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653734:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507978240:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 42us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653740:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1789480247.653753:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789480247.653759:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977600:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480247.653782:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2402:x1876405507977600:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653799:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1789480247.653811:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:0.0:1789480247.653817:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507978112:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1789480247.653841:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2402:x1876405507978112:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 24us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653847:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00080000:0.0:1789480247.653869:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789480247.653871:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789480247.653882:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:0.0:1789480247.653890:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2402:x1876405507977856:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1789480247.653899:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:0.0:1789480247.653921:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2402:x1876405507977856:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 31us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.653929:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1789480247.855919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480247.856315:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978368 00000100:00100000:2.0:1789480247.856329:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978368 00000100:00100000:2.0:1789480247.856424:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1789480247.856437:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:15590:x1876405507978368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480247.856465:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480247.856495:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047b200/0xdaa289fda243e909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f85 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860463:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860485:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860498:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860535:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860614:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860623:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860700:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047ba00/0xdaa289fda243e91e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860709:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047ba00/0xdaa289fda243e91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860716:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047ba00/0xdaa289fda243e91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480247.860744:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789480247.860748:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789480247.860788:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047ba00/0xdaa289fda243e91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860817:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860824:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860831:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860901:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047be00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480247.860905:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860913:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860925:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:2.0:1789480247.860928:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480247.860932:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860939:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860955:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860961:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860967:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860979:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480247.860982:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860988:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.860996:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a6987bf3200) 00010000:00010000:2.0:1789480247.860999:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480247.861002:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.861008:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e917 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.861051:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047b200/0xdaa289fda243e909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f85 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.861066:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047ba00/0xdaa289fda243e91e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f85 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.861074:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6987bf3d00) 00010000:00010000:2.0:1789480247.861076:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789480247.861078:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047ba00, rc 0) 00000100:00100000:2.0:1789480247.861151:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15590:x1876405507978368:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 4716us (5246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480247.861161:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:3.0:1789480247.868610:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480247.869114:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978496 00000100:00100000:0.0:1789480247.869128:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978496 00000100:00100000:0.0:1789480247.869299:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1789480247.869310:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15590:x1876405507978496:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789480247.869432:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15590:x1876405507978496:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 Request processed in 124us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.869439:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:3.0:1789480247.873898:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480247.874311:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978752 00000100:00100000:0.0:1789480247.874323:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978752 00000100:00100000:0.0:1789480247.874414:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1789480247.874427:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:15590:x1876405507978752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480247.874473:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480247.874503:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e925 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f8c expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.874599:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.874618:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.874632:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.876953:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.876972:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.876984:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877383:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0800/0xdaa289fda243e93a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877393:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0800/0xdaa289fda243e93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877400:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0800/0xdaa289fda243e93a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480247.877413:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789480247.877600:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877608:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877615:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877621:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5da000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480247.877625:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877632:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877643:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a6987bf3d00) 00010000:00010000:0.0:1789480247.877646:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.877650:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877657:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243e92c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877671:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877677:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877682:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877696:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480247.877699:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877704:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877711:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a6a88c27400) 00010000:00010000:0.0:1789480247.877714:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.877716:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.877722:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e933 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.881620:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243e925 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f8c expref: 10 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.881649:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0800/0xdaa289fda243e93a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f8c expref: 9 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.881658:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a88c27b00) 00010000:00010000:0.0:1789480247.881661:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.881665:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0800, rc 0) 00000100:00100000:0.0:1789480247.881737:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15590:x1876405507978752:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 7311us (7856us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789480247.881746:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1789480247.901693:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480247.901830:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507978880 00000100:00100000:0.0:1789480247.901871:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507978880 00000100:00100000:0.0:1789480247.901940:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1789480247.901950:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15590:x1876405507978880:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789480247.902064:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15590:x1876405507978880:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 115us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480247.902083:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:3.0:1789480247.909768:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480247.909899:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979008 00000100:00100000:2.0:1789480247.909912:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979008 00000100:00100000:2.0:1789480247.909982:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:2.0:1789480247.909995:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:15590:x1876405507979008:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789480247.911409:0:17154:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1356us 00000100:00100000:1.0:1789480247.949726:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:15590:x1876405507979008:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 39710us (39947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480247.949745:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1789480247.973240:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480247.973428:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979136 00000100:00100000:0.0:1789480247.973442:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979136 00000100:00100000:0.0:1789480247.973516:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:0.0:1789480247.973529:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15596:x1876405507979136:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480247.973555:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480247.973586:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e948 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f93 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973672:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973690:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973703:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973720:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973727:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973734:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973821:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973830:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973837:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973844:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480247.973849:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973858:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973871:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:0.0:1789480247.973875:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.973881:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973888:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243e94f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973901:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973907:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973912:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973924:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480247.973927:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973934:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973942:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6a88c27400) 00010000:00010000:0.0:1789480247.973945:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.973947:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973953:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243e956 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.973990:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e948 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f93 expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.974006:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:0.0:1789480247.974008:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480247.974012:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243e948 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f93 expref: 10 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480247.974023:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:0.0:1789480247.974106:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15596:x1876405507979136:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 580us (917us total) trans 0 rc 301/301 00000100:00100000:0.0:1789480247.974114:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1789480247.984938:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480247.985423:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979264 00000100:00100000:2.0:1789480247.985436:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979264 00000100:00100000:2.0:1789480247.985507:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789480247.985520:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15596:x1876405507979264:12345-192.168.206.44@tcp:700:lfs.0 00000100:00100000:2.0:1789480247.986855:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15596:x1876405507979264:12345-192.168.206.44@tcp:700:lfs.0 Request processed in 1329us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480247.986869:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1789480247.989711:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480247.989950:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979520 00000100:00100000:2.0:1789480247.989964:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979520 00000100:00100000:2.0:1789480247.990038:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:2.0:1789480247.990051:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:15596:x1876405507979520:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:2.0:1789480247.990138:0:18681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480247.990173:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243e876 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f00 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.990238:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:2.0:1789480247.990245:0:18681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480247.990316:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.990333:0:18681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.990375:0:18681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.990420:0:18681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 5 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.990437:0:18681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 5 pid: 17154 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480247.990454:0:18681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1876405527997312:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480247.990548:0:18681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6aaa2fea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789480247.997562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480247.997644:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979648 00000100:00100000:1.0:1789480247.997657:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979648 00010000:00010000:1.0:1789480247.997710:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 6 pid: 17154 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480247.997779:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:1.0:1789480247.997791:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2402:x1876405507979648:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480247.997810:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480247.997818:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 6 pid: 17154 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480247.997856:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 6 pid: 17154 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480247.997887:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:1.0:1789480247.997894:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480247.997906:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480247.997915:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480247.997940:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480247.998010:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2402:x1876405507979648:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 220us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480247.998019:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00010000:00010000:2.0:1789480247.998231:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd200/0xdaa289fda243e8b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f70 expref: 5 pid: 17154 timeout: 716 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480247.998252:0:18681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18681:1876405527997312:192.168.206.44@tcp:104: 00010000:00010000:2.0:1789480247.998281:0:18681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.998290:0:18681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.998297:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.998326:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.998336:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480247.998365:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480248.005553:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527997440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789480248.005672:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480248.005722:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527997440 00000100:00100000:0.0:1789480248.005746:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527997440 00000100:00100000:0.0:1789480248.005823:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789480248.005836:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527997440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789480248.005874:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789480248.005973:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405527997440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.005981:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789480248.006127:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405527997440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789480248.006322:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789480248.008645:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008666:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008677:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480248.008694:0:18681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fdaae03 reply state 0000000032f38aad transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008704:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008711:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:2.0:1789480248.008714:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480248.008718:0:18681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789480248.008722:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789480248.008730:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008737:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008743:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008758:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.008763:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008770:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008780:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6a99bd7b00) 00010000:00010000:2.0:1789480248.008782:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480248.008786:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008791:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e95d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480248.008810:0:18681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fdaae03 reply state 0000000032f38aad transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008817:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.008823:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6987bf3200) 00010000:00010000:2.0:1789480248.008825:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480248.008827:0:18681:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789480248.008918:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+10:15596:x1876405507979520:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 18867us (19217us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789480248.008927:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000040:00080000:0.0:1789480248.068871:0:17904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789480248.070465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.070655:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979776 00000100:00100000:2.0:1789480248.070667:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979776 00000100:00100000:2.0:1789480248.071108:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:2.0:1789480248.071139:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+10:15604:x1876405507979776:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:2.0:1789480248.071172:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.071481:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031200/0xdaa289fda243e972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2f9a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.071568:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030600/0xdaa289fda243e979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.071585:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030600/0xdaa289fda243e979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.071703:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030600/0xdaa289fda243e979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480248.072003:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480248.072009:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480248.072059:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030600/0xdaa289fda243e979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.072094:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031200/0xdaa289fda243e972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f9a expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.072119:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030600/0xdaa289fda243e979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2f9a expref: 11 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.072129:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:1.0:1789480248.072132:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480248.072137:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030600, rc 0) 00000100:00100000:1.0:1789480248.072390:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+11:15604:x1876405507979776:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 1254us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.072399:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1789480248.101277:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.105613:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507979904 00000100:00100000:1.0:1789480248.105637:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507979904 00000100:00100000:1.0:1789480248.105734:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1789480248.105747:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:15605:x1876405507979904:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480248.105775:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.105802:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031200/0xdaa289fda243e980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fa1 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.105884:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243e987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.105924:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243e987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.105940:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243e987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480248.105995:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480248.105999:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480248.106026:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243e987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.106056:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80031200/0xdaa289fda243e980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fa1 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.106077:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a80030200/0xdaa289fda243e987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fa1 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.106087:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:1.0:1789480248.106090:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480248.106095:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a80030200, rc 0) 00000100:00100000:1.0:1789480248.106184:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15605:x1876405507979904:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 440us (4922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.106265:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:3.0:1789480248.108741:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.109423:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507980032 00000100:00100000:1.0:1789480248.109437:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507980032 00000100:00100000:1.0:1789480248.109630:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:1.0:1789480248.109642:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:15605:x1876405507980032:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1789480248.109670:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.109745:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243e98e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fa8 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.109826:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.109842:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110000:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110018:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110027:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110035:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110150:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110158:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110165:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480248.110234:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480248.110238:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480248.110260:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110281:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110287:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110294:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110300:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ab796c200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480248.110313:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110322:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110335:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:1.0:1789480248.110338:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480248.110352:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110359:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e995 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110373:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110379:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110384:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110395:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ab796dc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480248.110398:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110404:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110412:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6987bf3200) 00010000:00010000:1.0:1789480248.110414:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480248.110417:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110423:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e99c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110452:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243e98e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fa8 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110467:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fa8 expref: 7 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.110474:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:1.0:1789480248.110477:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789480248.110479:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ab796ca00, rc 0) 00000100:00100000:1.0:1789480248.110561:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+7:15605:x1876405507980032:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 922us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.110568:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1789480248.112920:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.113080:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507980160 00000100:00100000:0.0:1789480248.113092:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507980160 00000100:00100000:0.0:1789480248.113160:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1789480248.113171:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:15605:x1876405507980160:12345-192.168.206.44@tcp:900:lfs.0 00000100:00100000:0.0:1789480248.113277:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:15605:x1876405507980160:12345-192.168.206.44@tcp:900:lfs.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.113286:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:0.0:1789480248.116380:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.116537:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507980416 00000100:00100000:3.0:1789480248.116550:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507980416 00000100:00100000:3.0:1789480248.116622:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:3.0:1789480248.116635:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+7:15605:x1876405507980416:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480248.116663:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480248.116690:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e9aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2faf expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480248.116966:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789480248.117110:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e9aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2faf expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.117126:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:3.0:1789480248.117130:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789480248.117135:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e9aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2faf expref: 9 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.117153:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecdc00, rc 0) 00000100:00100000:3.0:1789480248.117252:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+8:15605:x1876405507980416:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 619us (885us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789480248.117260:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:0.0:1789480248.121655:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.121769:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507980672 00000100:00100000:2.0:1789480248.121781:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507980672 00000100:00100000:2.0:1789480248.121997:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:2.0:1789480248.122009:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+8:15605:x1876405507980672:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:2.0:1789480248.122080:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480248.122116:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796ca00/0xdaa289fda243e9a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fa8 expref: 8 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.122139:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:2.0:1789480248.122145:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480248.122173:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.122414:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.122428:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789480248.122851:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3fa966f reply state 00000000350befe8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.123103:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.123111:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:2.0:1789480248.123114:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789480248.123134:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789480248.123144:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789480248.123538:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+9:15605:x1876405507980672:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 1526us (1892us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789480248.123548:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1789480248.125982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.126431:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507980928 00000100:00100000:2.0:1789480248.126444:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507980928 00000100:00100000:2.0:1789480248.126517:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:3.0:1789480248.126524:0:17155:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789480248.126528:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+9:15605:x1876405507980928:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480248.126535:0:17155:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789480248.126828:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8eab9df4-7373-4ca4-b729-98f6df36cc2b+10:15605:x1876405507980928:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 301us (858us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789480248.126836:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1789480248.131679:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.131778:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981184 00000100:00100000:2.0:1789480248.131792:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981184 00000100:00100000:2.0:1789480248.131865:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:2.0:1789480248.131879:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+10:15605:x1876405507981184:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480248.131910:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480248.131939:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047b200/0xdaa289fda243e9bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fb6 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132047:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132063:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132077:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132126:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132135:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132142:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480248.132462:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789480248.132553:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132563:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132570:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132577:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bdc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.132581:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132590:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132604:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:2.0:1789480248.132607:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480248.132612:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132632:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243e9c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132650:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132656:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132663:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132668:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.132671:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132677:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132684:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6987bf3200) 00010000:00010000:2.0:1789480248.132687:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480248.132690:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132696:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243e9cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132734:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047b200/0xdaa289fda243e9bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fb6 expref: 12 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132754:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:2.0:1789480248.132757:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480248.132761:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047b200/0xdaa289fda243e9bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fb6 expref: 12 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.132772:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ac047b200, rc 0) 00000100:00100000:2.0:1789480248.132931:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+11:15605:x1876405507981184:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1055us (1265us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789480248.132940:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:1.0:1789480248.144448:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.144560:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981312 00000100:00100000:3.0:1789480248.144574:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981312 00000100:00100000:3.0:1789480248.144651:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1789480248.144664:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+11:15605:x1876405507981312:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:3.0:1789480248.144694:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480248.144782:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e9db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fbd expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.144915:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.144932:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.144946:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789480248.144978:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789480248.144982:0:17154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789480248.145006:0:17154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.145038:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243e9db lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.145060:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.145069:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:3.0:1789480248.145072:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789480248.145087:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecde00, rc 0) 00000100:00100000:3.0:1789480248.145280:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+12:15605:x1876405507981312:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 618us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480248.145289:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:2.0:1789480248.152641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.152777:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981440 00000100:00100000:1.0:1789480248.152790:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981440 00000100:00100000:1.0:1789480248.152861:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:1.0:1789480248.152874:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+12:15605:x1876405507981440:12345-192.168.206.44@tcp:37:lfs.0 00000100:00100000:1.0:1789480248.159124:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8eab9df4-7373-4ca4-b729-98f6df36cc2b+12:15605:x1876405507981440:12345-192.168.206.44@tcp:37:lfs.0 Request processed in 6228us (6472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.159141:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1789480248.163385:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.163472:0:20290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981696 00000100:00100000:3.0:1789480248.163485:0:20290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981696 00000100:00100000:3.0:1789480248.163577:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1789480248.163588:0:20290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987b69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+12:15605:x1876405507981696:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:3.0:1789480248.163867:0:20290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987b69850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+13:15605:x1876405507981696:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 280us (564us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789480248.163875:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:2.0:1789480248.209599:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.209859:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981824 00000100:00100000:1.0:1789480248.209872:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981824 00000100:00100000:1.0:1789480248.209976:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:1.0:1789480248.209988:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+11:15611:x1876405507981824:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480248.210014:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.210043:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243e9e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fc4 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210143:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210161:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210174:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210185:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210289:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210484:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210586:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796de00/0xdaa289fda243e9fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210595:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796de00/0xdaa289fda243e9fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210603:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796de00/0xdaa289fda243e9fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480248.210650:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789480248.210654:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789480248.210706:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796de00/0xdaa289fda243e9fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210862:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210870:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210876:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210882:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ab796dc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480248.210887:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210894:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210915:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:1.0:1789480248.210917:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480248.210925:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210931:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796dc00/0xdaa289fda243e9f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210945:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210951:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210956:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210960:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ab796c200 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:1.0:1789480248.210963:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210967:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210973:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6987bf3200) 00010000:00010000:1.0:1789480248.210976:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789480248.210978:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.210983:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c200/0xdaa289fda243e9f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.211027:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243e9e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fc4 expref: 13 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.211042:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796de00/0xdaa289fda243e9fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fc4 expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.211049:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:1.0:1789480248.211052:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789480248.211054:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ab796de00, rc 0) 00000100:00100000:1.0:1789480248.213247:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+12:15611:x1876405507981824:12345-192.168.206.44@tcp:101:bash.0 Request processed in 3245us (3643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.213264:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1789480248.218529:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.218633:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507981952 00000100:00100000:1.0:1789480248.218645:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507981952 00000100:00100000:1.0:1789480248.218713:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1789480248.218730:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:15611:x1876405507981952:12345-192.168.206.44@tcp:900:bash.0 00000100:00100000:1.0:1789480248.218834:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:15611:x1876405507981952:12345-192.168.206.44@tcp:900:bash.0 Request processed in 105us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.218841:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1789480248.224677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.224833:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507982208 00000100:00100000:1.0:1789480248.224846:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507982208 00000100:00100000:1.0:1789480248.224980:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:1.0:1789480248.224996:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+12:15611:x1876405507982208:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1789480248.225024:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.225052:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243ea05 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fcb expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.225527:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.225547:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.225559:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.225611:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.225628:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 12 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.225646:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997568:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480248.225830:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329540 going to sleep for 11 seconds 00000100:00100000:2.0:1789480248.229378:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.229542:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507982336 00000100:00100000:3.0:1789480248.229554:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507982336 00010000:00010000:3.0:1789480248.229610:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 13 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480248.229662:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:3.0:1789480248.229674:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+13:2401:x1876405507982336:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789480248.229694:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789480248.229702:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 13 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.229728:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 13 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.229756:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:3.0:1789480248.229789:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.229802:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.229812:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.229839:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789480248.229919:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+13:2401:x1876405507982336:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 246us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480248.229927:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00010000:00010000:0.0:1789480248.230899:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecde00/0xdaa289fda243e9e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fbd expref: 12 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.230927:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997568:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480248.230953:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.230964:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.230970:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231021:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231034:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231044:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231781:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231796:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231804:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480248.231817:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789480248.231848:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231856:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231863:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231869:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c1e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.231874:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231882:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231893:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:0.0:1789480248.231896:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480248.231900:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231925:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea0c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480248.231940:0:17154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000022ea9412 reply state 00000000fef8064f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231952:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.231958:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a6a88c27400) 00010000:00010000:0.0:1789480248.231960:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480248.231964:0:17154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789480248.232011:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796cc00/0xdaa289fda243ea05 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.232032:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 14 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.232040:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.232043:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789480248.232045:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0400, rc 0) 00000100:00100000:0.0:1789480248.232124:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+15:15611:x1876405507982208:12345-192.168.206.44@tcp:101:bash.0 Request processed in 7131us (7460us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789480248.232133:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:2.0:1789480248.249848:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.249971:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507982464 00000100:00100000:0.0:1789480248.249983:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507982464 00000100:00100000:0.0:1789480248.250060:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:0.0:1789480248.250073:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+15:15611:x1876405507982464:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1789480248.250134:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.250162:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea28 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fd2 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250290:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250307:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250321:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480248.250397:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480248.250402:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480248.250428:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250440:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250472:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea28 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 17 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250634:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 16 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.250646:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.250649:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480248.250654:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0a00, rc 0) 00000100:00100000:0.0:1789480248.250746:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:15611:x1876405507982464:12345-192.168.206.44@tcp:101:bash.0 Request processed in 675us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.250754:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1789480248.261866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.262243:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507982720 00000100:00100000:1.0:1789480248.262256:0:17155:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507982720 00000100:00100000:1.0:1789480248.262325:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1789480248.262338:0:17155:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:15611:x1876405507982720:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:1.0:1789480248.262748:0:17155:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+17:15611:x1876405507982720:12345-192.168.206.44@tcp:35:bash.0 Request processed in 410us (891us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789480248.262756:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:1.0:1789480248.382642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.382769:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507982976 00000100:00100000:2.0:1789480248.382782:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507982976 00000100:00100000:2.0:1789480248.382858:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:2.0:1789480248.382870:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+17:15621:x1876405507982976:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1789480248.382901:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480248.382927:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243ea36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fd9 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480248.383059:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789480248.383370:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243ea36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd9 expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.383403:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a6987bf3a00) 00010000:00010000:2.0:1789480248.383407:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480248.383414:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243ea36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd9 expref: 19 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.383432:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc400, rc 0) 00000100:00100000:2.0:1789480248.383773:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+18:15621:x1876405507982976:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 903us (1143us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789480248.383783:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:3.0:1789480248.390341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.391263:0:20290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507983232 00000100:00100000:1.0:1789480248.391279:0:20290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507983232 00000100:00100000:1.0:1789480248.391417:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1789480248.391430:0:20290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+18:15621:x1876405507983232:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1789480248.391744:0:20290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+19:15621:x1876405507983232:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 316us (1416us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789480248.391752:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:3.0:1789480248.433399:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.433524:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507983488 00000100:00100000:0.0:1789480248.433536:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507983488 00000100:00100000:0.0:1789480248.433670:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:0.0:1789480248.433682:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+19:15624:x1876405507983488:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1789480248.433736:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.433972:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea44 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fe0 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.434131:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.434149:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.434164:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480248.434179:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789480248.434371:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea44 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe0 expref: 22 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.434393:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe0 expref: 21 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.434402:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.434405:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789480248.434426:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5da800, rc 0) 00000100:00100000:0.0:1789480248.434564:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:15624:x1876405507983488:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 882us (1177us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789480248.434573:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1789480248.439220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.439289:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.439380:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507983744 00000100:00100000:1.0:1789480248.439393:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507983744 00000100:00100000:1.0:1789480248.439473:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1789480248.439484:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:2399:x1876405507983744:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480248.439503:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480248.439533:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe0 expref: 21 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.439556:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:1.0:1789480248.439568:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789480248.439675:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507983616 00000100:00100000:0.0:1789480248.439680:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507983616 00000100:00100000:0.0:1789480248.439730:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:0.0:1789480248.439737:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:15624:x1876405507983616:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:0.0:1789480248.439811:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439826:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439837:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439879:0:17154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439886:0:17154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439894:0:17154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439900:0:17154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb5daa00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.439905:0:17154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439913:0:17154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439930:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.439933:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789480248.439938:0:17154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.439944:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480248.440321:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:2399:x1876405507983744:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 836us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.440331:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:0.0:1789480248.440427:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15624:x1876405507983616:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 689us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.440448:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1789480248.443162:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.445512:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507984000 00000100:00100000:2.0:1789480248.445533:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507984000 00000100:00100000:2.0:1789480248.445688:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1789480248.445701:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15624:x1876405507984000:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1789480248.446764:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:15624:x1876405507984000:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 1057us (3606us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789480248.446777:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00010000:00010000:1.0:1789480248.519982:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480248.707253:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.707585:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507984256 00000100:00100000:1.0:1789480248.707597:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507984256 00000100:00100000:1.0:1789480248.707676:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1789480248.707705:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+21:15655:x1876405507984256:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:1.0:1789480248.707737:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.707764:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d600/0xdaa289fda243ea60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fe7 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.707897:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c000/0xdaa289fda243ea67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.707914:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c000/0xdaa289fda243ea67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.707926:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c000/0xdaa289fda243ea67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789480248.707939:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789480248.708115:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d600/0xdaa289fda243ea60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe7 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.708136:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c000/0xdaa289fda243ea67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe7 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.708167:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:1.0:1789480248.708170:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789480248.708174:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ab796c000, rc 0) 00000100:00100000:1.0:1789480248.708662:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:15655:x1876405507984256:12345-192.168.206.44@tcp:101:cat.0 Request processed in 972us (1471us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789480248.708670:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:1.0:1789480248.712308:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.712369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.712470:0:20290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507984512 00000100:00100000:3.0:1789480248.712483:0:20290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507984512 00000100:00100000:3.0:1789480248.712555:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1789480248.712569:0:20290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:15655:x1876405507984512:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:3.0:1789480248.713084:0:20290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+24:15655:x1876405507984512:12345-192.168.206.44@tcp:35:cat.0 Request processed in 517us (786us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789480248.713093:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:2.0:1789480248.713335:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507984640 00000100:00100000:2.0:1789480248.713352:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507984640 00000100:00100000:2.0:1789480248.713449:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1789480248.713458:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+24:2399:x1876405507984640:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480248.713473:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480248.713504:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c000/0xdaa289fda243ea67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fe7 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.713525:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.713550:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480248.713582:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:2399:x1876405507984640:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 125us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480248.713589:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:3.0:1789480248.765475:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.765573:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507984896 00000100:00100000:0.0:1789480248.765586:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507984896 00000100:00100000:0.0:1789480248.765667:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:0.0:1789480248.765679:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:15661:x1876405507984896:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1789480248.766248:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.766281:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243ea75 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2fee expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766665:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766744:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766755:0:17154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766835:0:17154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766875:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.766891:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 24 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.766906:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997696:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480248.767034:0:17154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.767043:0:17154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 24 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.767053:0:17154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997824:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480248.767077:0:17154:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6abb329180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480248.770980:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997696:192.168.206.44@tcp:104: 00000100:00100000:0.0:1789480248.771071:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.771230:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.771276:0:17154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17154:1876405527997824:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480248.771324:0:17154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480248.771495:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985152 00000100:00100000:1.0:1789480248.771495:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985024 00000100:00100000:2.0:1789480248.771505:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985152 00000100:00100000:1.0:1789480248.771505:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985024 00010000:00010000:2.0:1789480248.771549:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 26 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771549:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 26 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480248.771632:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1789480248.771638:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1789480248.771642:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+26:2401:x1876405507985152:12345-192.168.206.44@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789480248.771644:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+26:2401:x1876405507985024:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480248.771660:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480248.771668:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 26 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.771679:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 26 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.771723:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243ea1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fcb expref: 26 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.771740:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.771745:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.771755:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.771782:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480248.771854:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986b26c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+25:2401:x1876405507985152:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 212us (623us total) trans 0 rc 0/0 00010000:00010000:1.0:1789480248.771856:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480248.771862:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 25 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480248.771863:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00010000:00010000:1.0:1789480248.771872:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 25 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771884:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243ea2f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fd2 expref: 24 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771894:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:1.0:1789480248.771904:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771913:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771921:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.771954:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480248.771996:0:17154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.772004:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480248.772028:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:1.0:1789480248.772132:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+24:2401:x1876405507985024:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 487us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.772138:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00010000:00010000:2.0:1789480248.772263:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da000/0xdaa289fda243ea75 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fee expref: 24 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.772281:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5daa00/0xdaa289fda243ea7c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2fee expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.772289:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.772291:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789480248.772294:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb5daa00, rc 0) 00000100:00100000:2.0:1789480248.772322:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:15661:x1876405507984896:12345-192.168.206.44@tcp:101:dd.0 Request processed in 6646us (6861us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789480248.772330:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1789480248.774752:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.774857:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985280 00000100:00100000:0.0:1789480248.774871:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985280 00000100:00100000:0.0:1789480248.774944:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1789480248.774956:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+23:15661:x1876405507985280:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1789480248.774986:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.775033:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ff5 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775078:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775094:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775121:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775293:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb5da800/0xdaa289fda243ea8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 25 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775314:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 24 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.775323:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.775326:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789480248.775331:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c1e00, rc 0) 00000100:00100000:0.0:1789480248.775477:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+24:15661:x1876405507985280:12345-192.168.206.44@tcp:101:dd.0 Request processed in 522us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.775485:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:0.0:1789480248.778556:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.780182:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985536 00000100:00100000:2.0:1789480248.780614:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985536 00000100:00100000:2.0:1789480248.780969:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:2.0:1789480248.780983:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+24:15661:x1876405507985536:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:2.0:1789480248.781375:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.781400:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.781415:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789480248.781473:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789480248.781500:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd037dba reply state 00000000be04bf35 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.781514:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.781522:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.781525:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789480248.781530:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789480248.781646:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507985536:12345-192.168.206.44@tcp:36:dd.0 Request processed in 666us (3103us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789480248.781655:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000020:00080000:2.0:1789480248.781662:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789480248.784557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.784619:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985664 00000100:00100000:1.0:1789480248.784631:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985664 00000100:00100000:1.0:1789480248.784800:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:1.0:1789480248.784813:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507985664:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1789480248.784846:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.784874:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c600/0xdaa289fda243ea9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d2ffc expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.784947:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c600/0xdaa289fda243ea9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ffc expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.785026:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c600/0xdaa289fda243ea9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ffc expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.785051:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:1.0:1789480248.785071:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789480248.785076:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ab796c600, rc 0) 00000100:00100000:1.0:1789480248.785165:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15661:x1876405507985664:12345-192.168.206.44@tcp:101:dd.0 Request processed in 355us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.785173:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:1.0:1789480248.795795:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.795914:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507985920 00000100:00100000:2.0:1789480248.795927:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507985920 00000100:00100000:2.0:1789480248.796012:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:2.0:1789480248.796025:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15661:x1876405507985920:12345-192.168.206.44@tcp:103:dd.0 00010000:00010000:2.0:1789480248.796046:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480248.796077:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796c600/0xdaa289fda243ea9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ffc expref: 28 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.796126:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.796132:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480248.796447:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507985920:12345-192.168.206.44@tcp:103:dd.0 Request processed in 423us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480248.796456:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1789480248.801858:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.801963:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986048 00000100:00100000:3.0:1789480248.801976:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986048 00000100:00100000:3.0:1789480248.802053:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1789480248.802065:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507986048:12345-192.168.206.44@tcp:58:dd.0 00010000:00010000:3.0:1789480248.802269:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.802292:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.802306:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789480248.803674:0:17154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789480248.807520:0:17154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789480248.807795:0:17154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789480248.807940:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507986048:12345-192.168.206.44@tcp:58:dd.0 Request processed in 5870us (6089us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480248.807954:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:3.0:1789480248.812953:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.819311:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986176 00000100:00100000:0.0:1789480248.819331:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986176 00000100:00100000:0.0:1789480248.819425:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:0.0:1789480248.819436:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+27:15661:x1876405507986176:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:0.0:1789480248.819493:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.819525:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d3003 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819594:0:18681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819606:0:18681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 28 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819630:0:18681:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819644:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 28 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819661:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.819664:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789480248.819668:0:18681:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 28 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.819675:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb3c0400, rc 0) 00000100:00100000:0.0:1789480248.819775:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15661:x1876405507986176:12345-192.168.206.44@tcp:101:dd.0 Request processed in 340us (6832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.819782:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000040:00080000:1.0:1789480248.836569:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789480248.836580:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789480248.836628:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789480248.836641:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789480248.837011:0:17185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a983dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1876405527997952:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789480248.837354:0:17185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9aa6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789480248.841834:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.842298:0:17185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a983dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1876405527997952:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789480248.843535:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986304 00000100:00100000:2.0:1789480248.843555:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986304 00000100:00100000:2.0:1789480248.843622:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:2.0:1789480248.843632:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15662:x1876405507986304:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789480248.843665:0:17151:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789480248.843785:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15662:x1876405507986304:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 154us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480248.843792:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:2.0:1789480248.851581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.851781:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986432 00000100:00100000:0.0:1789480248.851794:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986432 00000100:00100000:0.0:1789480248.851874:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1789480248.851903:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a866f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15662:x1876405507986432:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789480248.852003:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.852024:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.852039:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854043:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854066:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854079:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854127:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854136:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854142:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480248.854212:0:18681:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789480248.854217:0:18681:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480248.854302:0:18681:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854331:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854337:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854354:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854360:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.854365:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854372:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854384:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a88c27b00) 00010000:00010000:0.0:1789480248.854386:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480248.854391:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854398:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0a00/0xdaa289fda243eab4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854412:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854418:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854424:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854435:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81486e00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.854438:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854444:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854452:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a6a88c27000) 00010000:00010000:0.0:1789480248.854455:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480248.854468:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854474:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486e00/0xdaa289fda243eabb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854489:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854495:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854501:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854505:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81487a00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.854508:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854513:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854531:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:0.0:1789480248.854533:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789480248.854536:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.854663:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487a00/0xdaa289fda243eac2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.854753:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a866f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15662:x1876405507986432:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 2849us (3183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.854763:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1789480248.861849:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.861937:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986688 00000100:00100000:2.0:1789480248.861953:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986688 00000100:00100000:2.0:1789480248.862044:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:2.0:1789480248.862056:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+28:15662:x1876405507986688:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480248.862084:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480248.862110:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eac9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d300a expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862446:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862483:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862496:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789480248.862509:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789480248.862599:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862606:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862613:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862619:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.862623:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862631:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862643:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480248.862645:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789480248.862650:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862656:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243ead0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862712:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eac9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d300a expref: 30 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862731:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a6a88c27b00) 00010000:00010000:2.0:1789480248.862733:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789480248.862737:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eac9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d300a expref: 30 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.862747:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc800, rc 0) 00000100:00100000:2.0:1789480248.862954:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+29:15662:x1876405507986688:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 899us (1112us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789480248.862963:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:3.0:1789480248.865827:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480248.866009:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507986816 00000100:00100000:1.0:1789480248.866023:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507986816 00000100:00100000:1.0:1789480248.866093:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1789480248.866106:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+29:15662:x1876405507986816:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789480248.866155:0:17153:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789480248.866585:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+29:15662:x1876405507986816:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 480us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.866594:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:1.0:1789480248.871505:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.871925:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987072 00000100:00100000:3.0:1789480248.871938:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987072 00000100:00100000:3.0:1789480248.872054:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:3.0:1789480248.872067:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+29:15662:x1876405507987072:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480248.872127:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480248.872156:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eade lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d3011 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789480248.872716:0:17154:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:3.0:1789480248.872725:0:17154:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:3.0:1789480248.872761:0:17154:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789480248.872941:0:17154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243eae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.872959:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243eae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.872973:0:17154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243eae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.873044:0:17154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eade lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3011 expref: 32 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.873075:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243eae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3011 expref: 31 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.873085:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6abba47c00) 00010000:00010000:3.0:1789480248.873089:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789480248.873092:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecc800, rc 0) 00000100:00100000:3.0:1789480248.873172:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+31:15662:x1876405507987072:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1107us (1680us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1789480248.873181:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:0.0:1789480248.878330:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.880239:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987328 00000100:00100000:2.0:1789480248.880260:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987328 00000100:00100000:2.0:1789480248.880363:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:2.0:1789480248.880375:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+31:15662:x1876405507987328:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789480248.880485:0:18681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480248.880519:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc800/0xdaa289fda243eae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3011 expref: 31 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880542:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6abba47c00) 00010000:00010000:2.0:1789480248.880555:0:18681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789480248.880583:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880600:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880611:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880638:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880646:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880666:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880722:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880730:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880737:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880744:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.880748:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880757:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880765:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:2.0:1789480248.880768:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480248.880772:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880777:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc800/0xdaa289fda243eaf3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880795:0:18681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880801:0:18681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880806:0:18681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880811:0:18681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480248.880814:0:18681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880820:0:18681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880827:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4f87b1ab (ffff8a6987bf3500) 00010000:00010000:2.0:1789480248.880829:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480248.880832:0:18681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.880837:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc000/0xdaa289fda243eafa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4f87b1ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480248.880943:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+30:15662:x1876405507987328:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 570us (2627us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789480248.880951:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1789480248.885587:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.885678:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987456 00000100:00100000:2.0:1789480248.885691:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987456 00000100:00100000:2.0:1789480248.885841:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1789480248.885873:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+30:15662:x1876405507987456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789480248.885898:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480248.885926:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd400/0xdaa289fda243eb01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d3018 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.885985:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243eb08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.886001:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243eb08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.886013:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243eb08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.886148:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bd400/0xdaa289fda243eb01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3018 expref: 32 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.886172:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc400/0xdaa289fda243eb08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3018 expref: 31 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480248.886181:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:2.0:1789480248.886183:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480248.886187:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bc400, rc 0) 00000100:00100000:2.0:1789480248.886289:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+31:15662:x1876405507987456:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 423us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480248.886297:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1789480248.888944:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.889093:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987712 00000100:00100000:0.0:1789480248.889107:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987712 00000100:00100000:0.0:1789480248.889183:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1789480248.889363:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+31:15662:x1876405507987712:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480248.889475:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.889495:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.889509:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789480248.889744:0:17153:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789480248.889755:0:17153:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 617813564050ns, next at 618813561326ns, rc = 0 00000004:00010000:0.0:1789480248.889842:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075420a84 reply state 00000000b8b2b651 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.889857:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.889866:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:0.0:1789480248.889869:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789480248.889873:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480248.890003:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+33:15662:x1876405507987712:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 808us (1070us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789480248.890011:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1789480248.902762:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480248.903040:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987840 00000100:00100000:3.0:1789480248.903079:0:17154:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987840 00000100:00100000:3.0:1789480248.903172:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480248.903224:0:17154:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+33:15662:x1876405507987840:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789480248.903260:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789480248.903292:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d301f expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.903387:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.903407:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 34 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.903432:0:17154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:3.0:1789480248.903435:0:17154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789480248.903441:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6987ecd000, rc 0) 00000100:00100000:3.0:1789480248.903737:0:17154:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+34:15662:x1876405507987840:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 554us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480248.903756:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:3.0:1789480248.908146:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.908895:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507987968 00000100:00100000:0.0:1789480248.908910:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507987968 00000100:00100000:0.0:1789480248.909002:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1789480248.909015:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2401:x1876405507987968:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789480248.911069:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2401:x1876405507987968:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 2041us (2933us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789480248.911088:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1789480248.915677:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.916020:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507988224 00000100:00100000:2.0:1789480248.916033:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507988224 00000100:00100000:2.0:1789480248.916113:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1789480248.916143:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+34:15662:x1876405507988224:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789480248.916654:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+35:15662:x1876405507988224:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 511us (988us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789480248.916664:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1789480248.924003:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480248.926883:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507988480 00000100:00100000:2.0:1789480248.926904:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507988480 00000100:00100000:2.0:1789480248.927067:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1789480248.927081:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+35:15662:x1876405507988480:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789480248.927310:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+35:15662:x1876405507988480:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 231us (3884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480248.927319:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:3.0:1789480248.931434:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.932087:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507988608 00000100:00100000:0.0:1789480248.932111:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507988608 00000100:00100000:0.0:1789480248.932475:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:0.0:1789480248.932487:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+35:15662:x1876405507988608:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789480248.932513:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789480248.932539:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d3026 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932666:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932684:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932696:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789480248.932867:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789480248.932892:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932920:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3026 expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932942:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3026 expref: 36 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.932950:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:0.0:1789480248.932953:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789480248.932957:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6a81486800, rc 0) 00000100:00100000:0.0:1789480248.933039:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+36:15662:x1876405507988608:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 554us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.933047:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1789480248.935694:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.941264:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507988736 00000100:00100000:0.0:1789480248.941286:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507988736 00000100:00100000:1.0:1789480248.946725:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:1.0:1789480248.946745:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2402:x1876405507988736:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789480248.946791:0:18659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789480248.946822:0:18659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d302d expref: -99 pid: 18659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789480248.946857:0:18659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa94d38, blocks: 0x0 00010000:00010000:1.0:1789480248.946883:0:18659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=617s v=(0 0) 00010000:00010000:1.0:1789480248.946888:0:18659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480248.946899:0:18659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 7 pid: 18659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.946921:0:18659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 7 pid: 18659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480248.946936:0:18659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6ab796d200, rc 0) 00000100:00100000:1.0:1789480248.947020:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:2402:x1876405507988736:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 281us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480248.947028:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1789480248.954526:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.954621:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507988992 00000100:00100000:0.0:1789480248.954648:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507988992 00000100:00100000:0.0:1789480248.954720:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1789480248.954733:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+36:15662:x1876405507988992:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789480248.954880:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+36:15662:x1876405507988992:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 149us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.954888:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:3.0:1789480248.957732:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.957814:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507989120 00000100:00100000:0.0:1789480248.957827:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507989120 00000100:00100000:0.0:1789480248.957900:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:0.0:1789480248.957912:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+36:15662:x1876405507989120:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789480248.960179:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789480248.960236:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789480248.960297:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1789480248.960772:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960788:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960807:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960813:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047be00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480248.960818:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960828:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960846:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a6987bf3200) 00010000:00010000:3.0:1789480248.960850:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480248.960856:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960863:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047be00/0xdaa289fda243e964 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960891:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960897:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960903:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960908:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480248.960910:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960927:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960936:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:3.0:1789480248.960939:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480248.960942:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960948:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a600/0xdaa289fda243e96b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960966:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960973:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960978:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960983:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb3c0600 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480248.960986:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.960992:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961000:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a6a88c27400) 00010000:00010000:3.0:1789480248.961002:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480248.961005:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961021:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0600/0xdaa289fda243ea13 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961041:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961046:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961052:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961058:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bda00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480248.961060:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961067:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961076:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:3.0:1789480248.961079:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789480248.961082:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961088:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bda00/0xdaa289fda243ea98 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961168:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961175:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961187:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961248:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6a81486400 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:3.0:1789480248.961251:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961259:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961268:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:3.0:1789480248.961270:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789480248.961273:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480248.961278:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486400/0xdaa289fda243eb0f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480248.961301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789480248.961324:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a983dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527998080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789480248.961653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789480248.961795:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961804:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961810:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961815:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ac047a800 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:0.0:1789480248.961818:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961824:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961835:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a6987bf3600) 00010000:00010000:0.0:1789480248.961837:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789480248.961840:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.961854:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ac047a800/0xdaa289fda243e9b8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480248.962006:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+15:15662:x1876405507989120:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 4093us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.962017:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:2.0:1789480248.962225:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527998080 00000100:00100000:2.0:1789480248.962235:0:19538:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527998080 00000100:00100000:2.0:1789480248.962294:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789480248.962305:0:19538:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6aab10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1876405527998080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789480248.962501:0:19538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789480248.962505:0:19538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789480248.962507:0:19538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789480248.962509:0:19538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789480248 -> 1789480248 00002000:00010000:2.0:1789480248.962512:0:19538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789480248.962563:0:19538:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6aab10d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1876405527998080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (912us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789480248.962581:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789480248.963024:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789480248.963295:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a6a983dd880/2, rc 0, transno 8589934596 00000100:00100000:0.0:1789480248.963304:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a983dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1876405527998080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789480248.967888:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.968022:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507989248 00000100:00100000:0.0:1789480248.968035:0:18657:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507989248 00000100:00100000:0.0:1789480248.968123:0:18657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:0.0:1789480248.968135:0:18657:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:2401:x1876405507989248:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789480248.968301:0:18657:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6986a1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:2401:x1876405507989248:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 168us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480248.968309:0:18657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1789480248.996165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480248.996500:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507989504 00000100:00100000:0.0:1789480248.996516:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507989504 00000100:00100000:0.0:1789480248.996595:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:0.0:1789480248.996607:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+15:15662:x1876405507989504:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789480248.996683:0:18681:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789480248.996720:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81486800/0xdaa289fda243eb24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3026 expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.996746:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:0.0:1789480248.996769:0:18681:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789480248.996810:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.996828:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.996840:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789480248.997022:0:18681:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000335e6331 reply state 000000009e45bc0e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.997039:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6a81487800/0xdaa289fda243eb32 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480248.997045:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:0.0:1789480248.997048:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789480248.997051:0:18681:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789480248.997184:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:15662:x1876405507989504:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 579us (1030us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1789480248.997384:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:3.0:1789480249.003435:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1789480249.003632:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507989632 00000100:00100000:0.0:1789480249.003645:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507989632 00000100:00100000:0.0:1789480249.003732:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1789480249.003745:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+7:2402:x1876405507989632:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789480249.003942:0:18659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789480249.003946:0:18659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789480248 00002000:00010000:0.0:1789480249.003949:0:18659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789480248 00002000:00010000:0.0:1789480249.003951:0:18659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789480248 -> 1789480248 00002000:00010000:0.0:1789480249.003970:0:18659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789480249.004057:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+8:2402:x1876405507989632:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 314us (636us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789480249.004066:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00080000:2.0:1789480249.004637:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789480249.007760:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480249.008466:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507989760 00000100:00100000:3.0:1789480249.008481:0:18658:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507989760 00000100:00100000:3.0:1789480249.008565:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1789480249.008579:0:18658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+8:2402:x1876405507989760:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789480249.008644:0:18658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008683:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480249.008689:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789480249.008697:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008728:0:18658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008763:0:18658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008772:0:18658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008781:0:18658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008789:0:18658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:3.0:1789480249.008794:0:18658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008803:0:18658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008820:0:18658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.008835:0:18658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c08fafbc/0xdaa289fda243eb39 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480249.008935:0:18658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+8:2402:x1876405507989760:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 360us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480249.008943:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1789480249.017680:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480249.017808:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990016 00000100:00100000:1.0:1789480249.017820:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990016 00000100:00100000:1.0:1789480249.017917:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:1.0:1789480249.017930:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:15662:x1876405507990016:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789480249.018059:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.018080:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 16 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.018119:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.018162:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 16 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.018177:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 16 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480249.018233:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998208:192.168.206.44@tcp:104: 00000100:00100000:1.0:1789480249.018329:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ab9aa6180 going to sleep for 11 seconds 00000100:00080000:2.0:1789480249.019612:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480249.020743:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998208:192.168.206.44@tcp:104: 00010000:00010000:1.0:1789480249.020782:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480249.023910:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480249.024160:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990144 00000100:00100000:2.0:1789480249.024172:0:17137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990144 00010000:00010000:2.0:1789480249.024258:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 17 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.024306:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1789480249.024317:0:17137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+17:2401:x1876405507990144:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789480249.024334:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789480249.024352:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 17 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024368:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 17 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024395:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c1e00/0xdaa289fda243ea91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d2ff5 expref: 17 pid: 18681 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024414:0:17137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480249.024420:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 16 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024432:0:17137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024458:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024466:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.024506:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789480249.024571:0:17137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:2401:x1876405507990144:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 255us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480249.024579:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00010000:00010000:3.0:1789480249.024811:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.024821:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.025326:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.025353:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.025364:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.025403:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 16 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.025419:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 16 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789480249.025450:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998336:192.168.206.44@tcp:104: 00000100:00100000:3.0:1789480249.025520:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789480249.028916:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789480249.028967:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527998464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480249.029071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789480249.029857:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527998464 00000100:00100000:1.0:1789480249.029869:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527998464 00000100:00100000:1.0:1789480249.029951:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789480249.029971:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527998464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789480249.030186:0:17893:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789480249.030389:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527998464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 429us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480249.030398:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789480249.030462:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527998464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789480249.031557:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527998592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789480249.031616:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480249.031858:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998336:192.168.206.44@tcp:104: 00010000:00010000:3.0:1789480249.031884:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480249.032357:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527998592 00000100:00100000:0.0:1789480249.032366:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527998592 00000100:00100000:0.0:1789480249.032425:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789480249.032436:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527998592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789480249.032476:0:17158:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789480249.032667:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527998592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 232us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480249.032675:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789480249.036108:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6abb5df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527998592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789480249.036885:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480249.037374:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990272 00000100:00100000:1.0:1789480249.037404:0:17139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990272 00010000:00010000:1.0:1789480249.037453:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 17 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480249.037538:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1789480249.037551:0:17139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+17:2401:x1876405507990272:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480249.037570:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480249.037578:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 17 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037593:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 17 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037618:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecd000/0xdaa289fda243eb16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d301f expref: 17 pid: 17154 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037636:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:1.0:1789480249.037642:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037654:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037664:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.037689:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480249.037779:0:17139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+16:2401:x1876405507990272:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 230us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480249.037797:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00010000:00010000:3.0:1789480249.037863:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789480249.037873:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480249.038048:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789480249.039037:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789480249.039114:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789480249.039264:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17151:1876405527998720:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789480249.039334:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480249.039382:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6ac1a6a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480249.040885:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527998720 00000100:00100000:2.0:1789480249.040902:0:17157:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527998720 00000100:00100000:2.0:1789480249.040995:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789480249.041406:0:17157:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17151:x1876405527998720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789480249.041625:0:17157:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17151:x1876405527998720:12345-0@lo:1000:mdt00_000.0 Request processed in 620us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480249.041634:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789480249.042403:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17151:1876405527998720:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789480249.042860:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789480249.043178:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17151:1876405527998848:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789480249.043477:0:17151:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480249.043556:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a82d3b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789480249.043615:0:17893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527998848 00000100:00100000:1.0:1789480249.043626:0:17893:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527998848 00000100:00100000:1.0:1789480249.043733:0:17893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789480249.043746:0:17893:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17151:x1876405527998848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789480249.043984:0:17893:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988821880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17151:x1876405527998848:12345-0@lo:1000:mdt00_000.0 Request processed in 241us (506us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789480249.043993:0:17893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789480249.045400:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988820000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17151:1876405527998848:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789480249.045484:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045495:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045504:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045511:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecc000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480249.045516:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045525:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045543:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:2.0:1789480249.045546:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480249.045552:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045559:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecc000/0xdaa289fda243eb47 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045598:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045606:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045612:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045629:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6987ecdc00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480249.045633:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045639:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045647:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480249.045650:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789480249.045658:0:17151:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 19 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045670:0:17151:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 19 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045680:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 19 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.045824:0:17151:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb3c0400/0xdaa289fda243eaad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3003 expref: 19 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.045841:0:17151:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998976:192.168.206.44@tcp:105: 00000100:00100000:2.0:1789480249.046077:0:17151:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a86826900 going to sleep for 11 seconds 00000100:00100000:0.0:1789480249.052629:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480249.053143:0:20290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990400 00000100:00100000:3.0:1789480249.053156:0:20290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990400 00000100:00100000:3.0:1789480249.053436:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:3.0:1789480249.053450:0:20290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987b6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15661:x1876405507990400:12345-192.168.206.44@tcp:49:dd.0 00000100:00100000:3.0:1789480249.053630:0:20290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987b6b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15661:x1876405507990400:12345-192.168.206.44@tcp:49:dd.0 Request processed in 183us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480249.053656:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1789480249.055137:0:17151:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1876405527998976:192.168.206.44@tcp:105: 00010000:00010000:2.0:1789480249.055176:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055225:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6987ecdc00/0xdaa289fda243eaa6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055463:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055482:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055495:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055507:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055514:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055522:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055527:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bde00 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480249.055532:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055539:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055551:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480249.055554:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789480249.055558:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055571:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bde00/0xdaa289fda243eb4e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055583:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055589:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055595:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055600:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6ab796d000 already unused, calling callback (ffffffffc197c4f0) 00010000:00010000:2.0:1789480249.055603:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055608:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055615:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480249.055617:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480249.055619:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.055624:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6ab796d000/0xdaa289fda243eb40 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.055985:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4e1b46fe-7168-46d1-8c19-6654dff86af2+19:15662:x1876405507990016:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 38055us (38316us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789480249.055997:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000020:00080000:2.0:1789480249.056075:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789480249.058391:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480249.058595:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480249.058632:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789480249.058641:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789480249.060967:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480249.062476:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990528 00000100:00100000:2.0:1789480249.062497:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990528 00000100:00100000:2.0:1789480249.062579:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:2.0:1789480249.062591:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+19:15661:x1876405507990528:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1789480249.062622:0:18681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789480249.062653:0:18681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb55 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x187a1d52fe5d3034 expref: -99 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062700:0:18681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243eb5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062733:0:18681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243eb5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062747:0:18681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243eb5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18681 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062907:0:18681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3034 expref: 21 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062932:0:18681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bdc00/0xdaa289fda243eb5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d3034 expref: 20 pid: 18681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.062941:0:18681:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a6a88c27500) 00010000:00010000:2.0:1789480249.062944:0:18681:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789480249.062949:0:18681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a6abb4bdc00, rc 0) 00000100:00100000:2.0:1789480249.063409:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15661:x1876405507990528:12345-192.168.206.44@tcp:101:dd.0 Request processed in 817us (2462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480249.063418:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:0.0:1789480249.075254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480249.075428:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990784 00000100:00100000:2.0:1789480249.075444:0:17156:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990784 00000100:00100000:2.0:1789480249.075504:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1789480249.075516:0:17156:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+20:15662:x1876405507990784:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789480249.075866:0:17156:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789480249.075909:0:17156:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789480249.075955:0:17156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.075978:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.075992:0:17156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.076002:0:17156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.076008:0:17156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.076015:0:17156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.076049:0:17156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789480249.076176:0:17156:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+22:15662:x1876405507990784:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 660us (992us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789480249.076184:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000020:00080000:2.0:1789480249.076226:0:17156:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789480249.076934:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789480249.076945:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.076956:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc600 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:0.0:1789480249.076961:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.076973:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.077021:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a6987bf3000) 00010000:00010000:0.0:1789480249.077024:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789480249.077032:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.077041:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a6abb4bc600/0xdaa289fda243eb63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17156 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.077059:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480249.077060:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480249.077062:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789480249.261282:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1789480249.264101:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507990912 00000100:00100000:3.0:1789480249.264116:0:18662:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507990912 00000100:00100000:0.0:1789480249.265282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480249.265469:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991040 00000100:00100000:2.0:1789480249.265477:0:18664:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991040 00000100:00100000:2.0:1789480249.265531:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789480249.265541:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+9:2399:x1876405507990912:12345-192.168.206.44@tcp:4:dd.0 00010000:00010000:2.0:1789480249.265575:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.265595:0:18664:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 9 pid: 18659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.265603:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789480249.265607:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480249.265611:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.265644:0:18664:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 9 pid: 18659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.265659:0:18664:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 9 pid: 18659 timeout: 718 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.265686:0:18664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:18664:1876405527999104:192.168.206.44@tcp:104: 00000100:00100000:2.0:1789480249.265770:0:18664:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a6a868266c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789480249.273045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1789480249.273123:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991168 00000100:00100000:1.0:1789480249.273133:0:17138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991168 00010000:00010000:1.0:1789480249.273174:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 10 pid: 18659 timeout: 718 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789480249.273240:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1789480249.273250:0:17138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+10:2401:x1876405507991168:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789480249.273265:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789480249.273285:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 10 pid: 18659 timeout: 718 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.273298:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 10 pid: 18659 timeout: 718 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.273324:0:17138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480249.273328:0:17138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789480249.273335:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.273374:0:17138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789480249.273397:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789480249.273474:0:17138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e1b46fe-7168-46d1-8c19-6654dff86af2+10:2401:x1876405507991168:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 203us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480249.273484:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00010000:00010000:0.0:1789480249.274116:0:18664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e633af7a/0xdaa289fda243eb2b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0x187a1d52fe5d302d expref: 9 pid: 18659 timeout: 718 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789480249.274132:0:18664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6988823480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0001_UUID:18664:1876405527999104:192.168.206.44@tcp:104: 00010000:00010000:0.0:1789480249.274156:0:18664:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.274167:0:18664:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789480249.274174:0:18664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789480249.374512:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1789480249.374529:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1789480249.374702:0:18664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789480249.374707:0:18664:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1789480248 -> 1789480249 00002000:00010000:2.0:1789480249.374710:0:18664:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789480248 -> 1789480249 00002000:00010000:2.0:1789480249.374712:0:18664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789480249.374741:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374755:0:18664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374765:0:18664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374773:0:18664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bde00 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480249.374778:0:18664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374787:0:18664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374806:0:18664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.374815:0:18664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084c1ba2f/0xdaa289fda243eb6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.374921:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+6:2399:x1876405507990912:12345-192.168.206.44@tcp:4:dd.0 Request processed in 109377us (113644us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789480249.374932:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:2.0:1789480249.376137:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1789480249.376152:0:18664:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991040:12345-192.168.206.44@tcp:4:dd.0 00002000:00010000:2.0:1789480249.377053:0:18664:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aa94d39, atime: 0x6aa94d38, ctime: 0x6aa94d39, blocks: 0x2000 00010000:00010000:2.0:1789480249.377064:0:18664:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.377078:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=618s v=(0 0) 00010000:00010000:2.0:1789480249.377082:0:18664:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789480249.377088:0:18664:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.377103:0:18664:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789480249.457545:0:19472:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789480249.457811:0:18664:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789480249.457817:0:18664:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789480249.457832:0:18664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457845:0:18664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457854:0:18664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457863:0:18664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a6abb4bc000 already unused, calling callback (ffffffffc0d558b0) 00010000:00010000:2.0:1789480249.457868:0:18664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457895:0:18664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457914:0:18664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789480249.457923:0:18664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9d923b/0xdaa289fda243eb71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789480249.458117:0:18664:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991040:12345-192.168.206.44@tcp:4:dd.0 Request processed in 81965us (192838us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789480249.458128:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00010000:00010000:1.0:1789480249.540698:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789480250.564550:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789480251.190645:0:20327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789480251.588648:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789480252.100613:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789480252.100636:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527999232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789480252.100697:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480252.100752:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999232 00000100:00100000:3.0:1789480252.100760:0:18660:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999232 00000100:00100000:3.0:1789480252.100813:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789480252.100821:0:18660:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ab7076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527999232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789480252.100848:0:18660:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789480252.100890:0:18660:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ab7076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876405527999232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480252.100896:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789480252.100917:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789480252.100952:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1876405527999232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789480252.101146:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480252.101176:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480252.101865:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527999872:0@lo:400:kworker.0 00000100:00100000:3.0:1789480252.101903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480252.101928:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405528000384:0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.101951:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527999488:0@lo:400:kworker.0 00000100:00100000:3.0:1789480252.101952:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480252.101977:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405528000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789480252.101996:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789480252.102009:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480252.102312:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405528000000:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.102315:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999488 00000100:00100000:2.0:1789480252.102353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480252.102373:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405528000512:0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.102394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789480252.102423:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999872 00000100:00100000:2.0:1789480252.102428:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999872 00000100:00100000:0.0:1789480252.102449:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527999744:0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.102476:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000384 00000100:00100000:2.0:1789480252.102481:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000384 00000100:00100000:0.0:1789480252.102485:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405528000256:0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102535:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a69894bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405528000768:0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102576:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102593:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789480252.102599:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6ab7075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527999616:0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102621:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102637:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405528000128:0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102653:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102664:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405528000640:0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102682:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789480252.102713:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999360 00000100:00100000:0.0:1789480252.102717:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999360 00000100:00100000:0.0:1789480252.102738:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000896 00000100:00100000:0.0:1789480252.102741:0:18661:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000896 00000100:00100000:0.0:1789480252.102757:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789480252.102760:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000512 00000100:00100000:0.0:1789480252.102766:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a983de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527999360:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789480252.102769:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000512 00002000:00000024:0.0:1789480252.102790:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789480252.102797:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000256 00000100:00100000:2.0:1789480252.102807:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000256 00000100:00100000:0.0:1789480252.102834:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a983de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405527999360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480252.102841:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789480252.102857:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789480252.102863:0:18661:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405528000896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789480252.102882:0:18661:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789480252.102893:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000768 00000100:00100000:2.0:1789480252.102899:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000768 00000100:00100000:0.0:1789480252.102916:0:18661:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876405528000896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.102919:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000640 00000100:00100000:2.0:1789480252.102923:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000640 00000100:00100000:0.0:1789480252.102925:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789480252.102946:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789480252.102953:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789480252.102956:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527999872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.102966:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405528000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.103000:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876405527999872:12345-0@lo:400:kworker.0 Request processed in 46us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480252.103011:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876405528000384:12345-0@lo:400:kworker.0 Request processed in 49us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480252.103017:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789480252.103032:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789480252.103038:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405528000512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789480252.103070:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1876405528000512:12345-0@lo:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789480252.103079:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789480252.103226:0:17147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999488 00000100:00100000:1.0:1789480252.103260:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789480252.103267:0:17147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3648:x1876405527999488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.103299:0:17147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:51483ccc-9e15-472d-aee3-1dbbbf4be94f+24:3648:x1876405527999488:12345-0@lo:400:kworker.0 Request processed in 33us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480252.103304:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789480252.103533:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999744 00000100:00100000:1.0:1789480252.103539:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999744 00000100:00100000:1.0:1789480252.103565:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000128 00000100:00100000:1.0:1789480252.103568:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000128 00000100:00100000:1.0:1789480252.103591:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789480252.103597:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527999744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.103644:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527999744:12345-0@lo:400:kworker.0 Request processed in 47us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480252.103650:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789480252.103663:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789480252.103669:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405528000128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.104164:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876405528000128:12345-0@lo:400:kworker.0 Request processed in 494us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480252.104171:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789480252.104210:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405528000000 00000100:00100000:1.0:1789480252.104214:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405528000000 00000100:00100000:1.0:1789480252.104240:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405527999616 00000100:00100000:1.0:1789480252.104243:0:17158:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405527999616 00000100:00100000:1.0:1789480252.104257:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480252.104262:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405528000000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.106816:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69888d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1876405528000000:12345-0@lo:400:kworker.0 Request processed in 2544us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480252.106829:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789480252.106859:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789480252.106870:0:17158:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527999616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.106934:0:17158:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876405527999616:12345-0@lo:400:kworker.0 Request processed in 68us (4311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789480252.106940:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789480252.107021:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789480252.107027:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a6a983dd880, transno 8589934596 00000004:00080000:1.0:1789480252.107039:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789480252.107065:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69888d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405528000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789480252.107090:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876405527999872:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107102:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1876405528000384:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107117:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a983df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1876405527999360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789480252.107263:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:51483ccc-9e15-472d-aee3-1dbbbf4be94f:3648:1876405527999488:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1876405528000000:0@lo:400:kworker.0 00010000:00080000:1.0:1789480252.107295:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a6a866eed80 x1876405528000512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480252.107305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1876405528000512:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107356:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527999616:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107369:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1876405528000128:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.107378:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6ab7074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1876405527999744:0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.108019:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789480252.108044:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480252.108055:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405528000256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.108125:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6988823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876405528000256:12345-0@lo:400:kworker.0 Request processed in 74us (5588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.108132:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789480252.108147:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480252.108153:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405528000768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.108185:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876405528000768:12345-0@lo:400:kworker.0 Request processed in 32us (5608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.108407:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789480252.108423:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789480252.108429:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a69894c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405528000640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789480252.108511:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a69894c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876405528000640:12345-0@lo:400:kworker.0 Request processed in 32us (5777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.108530:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1789480252.108635:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480252.108641:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480252.108653:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480252.108656:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789480252.108798:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1876405528000640:0@lo:400:kworker.0 00000100:00100000:1.0:1789480252.108811:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a6a866ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876405528000256:0@lo:400:kworker.0 00010000:00080000:1.0:1789480252.108821:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a69894bd880 x1876405528000768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789480268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789480252.108838:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a69894bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1876405528000768:0@lo:400:kworker.0 00000040:00080000:0.0:1789480252.165367:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789480252.165375:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789480252.165392:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789480252.165408:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1789480252.620805:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789480252.765006:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765055:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765075:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765099:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765147:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765164:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765183:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765227:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1789480252.765256:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991424 00000100:00100000:2.0:1789480252.765264:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991424 00000100:00100000:2.0:1789480252.765314:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991936 00000100:00100000:2.0:1789480252.765317:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991936 00000100:00100000:2.0:1789480252.765353:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991552 00000100:00100000:2.0:1789480252.765356:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991552 00000100:00100000:2.0:1789480252.765367:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507992064 00000100:00100000:2.0:1789480252.765369:0:18681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507992064 00000100:00100000:2.0:1789480252.765384:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:2.0:1789480252.765392:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+22:2399:x1876405507991424:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765463:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+22:2399:x1876405507991424:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 71us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765470:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:2.0:1789480252.765486:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:2.0:1789480252.765492:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2399:x1876405507991936:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765521:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+6:2399:x1876405507991936:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765543:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 71 00000100:00100000:2.0:1789480252.765557:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:2.0:1789480252.765563:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991552:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765588:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987dab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991552:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765594:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 72 00000100:00100000:2.0:1789480252.765605:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:2.0:1789480252.765611:0:18681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992064:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765634:0:18681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6abb56ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992064:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765640:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 73 00000100:00100000:2.0:1789480252.765658:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991680 00000100:00100000:2.0:1789480252.765662:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991680 00000100:00100000:2.0:1789480252.765686:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507992192 00000100:00100000:2.0:1789480252.765689:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507992192 00000100:00100000:2.0:1789480252.765699:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991808 00000100:00100000:2.0:1789480252.765701:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991808 00000100:00100000:2.0:1789480252.765712:0:18659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507992320 00000100:00100000:2.0:1789480252.765714:0:18659:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507992320 00000100:00100000:2.0:1789480252.765725:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1789480252.765731:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991680:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765754:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991680:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765761:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1789480252.765771:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1789480252.765783:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992192:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765810:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992192:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765816:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:2.0:1789480252.765829:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1789480252.765834:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991808:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765855:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6987da9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4e1b46fe-7168-46d1-8c19-6654dff86af2+5:2399:x1876405507991808:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765861:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:2.0:1789480252.765870:0:18659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1789480252.765876:0:18659:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992320:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1789480252.765895:0:18659:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6ac1c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8eab9df4-7373-4ca4-b729-98f6df36cc2b+5:2399:x1876405507992320:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 19us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789480252.765901:0:18659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00080000:2.0:1789480252.765924:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789480252.765927:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789480252.765930:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789480252.765932:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789480252.766006:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876405507991296 00000100:00100000:3.0:1789480252.766011:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876405507991296 00000100:00100000:3.0:1789480252.766059:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 168 00000100:00100000:3.0:1789480252.766067:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2399:x1876405507991296:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1789480252.766091:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a6a95ca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ea11d651-dcbe-4d90-aa74-3e752427f416+13:2399:x1876405507991296:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789480252.766097:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 168 Debug log: 43557 lines, 43557 kept, 0 dropped, 0 bad.